Human-computer interactive device and method

ABSTRACT

The present disclosure relates to a bioelectrical signal acquisition device, an interactive system, and related methods. The bioelectrical signal acquisition device includes a series of electrodes that are configured and positioned to effectively record bioelectrical signals from a user&#39;s head. The interactive system and related methods can be used to collect, display, and analyze the bioelectrical signals, especially signals related to sleep. The device, system, and methods can also be applied to modulate physiological or pathological conditions of the user.

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority to U.S. Provisional Patent ApplicationNo. 62/695,542, filed on Jul. 9, 2018, the entire contents of which arehereby incorporated by reference.

TECHNICAL FIELD

The present disclosure relates to devices, systems, and methods that canbe used in acquiring, measuring, and processing bioelectrical signals,with extensive applications in monitoring, analysis and/or modulation ofvarious physiological conditions, such as but not limited tosleep-monitoring, sleep pattern analysis, sleep-assistance, and othertypes of functions involving human-computer interactions.

BACKGROUND

Bioelectrical signals are generated by biological subjects and can becollected and processed. Such signals, and the patterns formed thereof,are being used to monitor, diagnose, and manipulate physiological andpathological conditions. Electroencephalogram (EEG), electromyogram(EMG), and electrooculography (EOG) signals are some typical examples ofbioelectrical signals.

In recent years, various types of devices and apparatus have beendeveloped to monitor bioelectrical signals, especially in the field ofsleep monitoring. However, the devices and apparatus almost invariablyface the problem of causing discomfort to the human subjects, typicallyby making it more difficult for them to fall asleep or disturbing thesleep patterns. Therefore, it is desirable to provide devices that caneffectively collect and process bioelectrical signals, with minimumdisturbance to the subjects regarding their physiological functions,such as sleep. In addition, it also would be desirable that such devicesare small, portable, wearable, wirelessly, and easy to use.

In some instances, measuring bioelectrical signals entails furtherinteraction with the human subject. However, common interactivebehaviors by the subject, such as looking at and touching screens and/ormonitors, are disruptive if the subject is trying to fall asleep. Whenthe human subject has been lying comfortably on bed, with eyes closedand is ready for sleep, body movements and exposure to light from thescreens would negatively affect sleep onset and sleep quality.Therefore, it would be ideal to interact with the subject with minimumintrusion. For sleep-assisting devices, sleep-recording devices, andassociated methods, it is desirable that the human subject can carry outcontrol or interact with the devices with as little action as possible,ideally without even opening their eyes or moving any major body parts.

SUMMARY

In one aspect, the present disclosure related to providing devices andmethods for monitoring human physiological and pathological conditions.In some embodiments, the present disclosure related to providing devicesand methods for monitoring sleep.

In another aspect, the present disclosure relates to providing devicesand methods for modulating human physiological and pathologicalconditions. In some embodiments, the present disclosure relates toproviding devices and methods modulating sleep (e.g., sleep assistance).

In another aspect, the present disclosure relates to providing devicesand methods that balance comfort and effectiveness in recording signalsfrom a user's head.

In another aspect, the present disclosure relates to providing devicesand methods that allows for effective interaction with a user that istrying to fall asleep. In some embodiments, the present disclosurerelates to providing devices and methods that allows for effectiveinteraction with a user without the user opening his/her eyes.

In another aspect, the present disclosure relates to providing devicesand methods that allows people to control a computational device withoutlooking at a screen or moving a finger, hand, limb, or mouth.

In some embodiments, the present disclosure relates to a 1. Abioelectrical signal acquisition device, comprising: a headbandconfigured to be wearable around a user's head, a sensing electrodeattached to the headband; a reference electrode attached to theheadband; wherein the sensing electrode and the one or more referenceelectrodes are configured to provide sensing signals from the user'shead, and the reference electrode is configured to cover at least partof a bottom side of a segment of the headband, and a processing unitconfigured to generate digital bioelectrical signals based on thesensing signals. In some embodiments, the bioelectrical signalacquisition device further includes a grounding electrode.

In some embodiments, the present disclosure relates to an interactivesystem, comprising: a bioelectrical signal acquisition device, and acomputational unit configured to receive the digital bioelectricalsignals from the bioelectrical signal acquisition device, process thedigital bioelectrical signals and execute one or more logic sets basedon the digital bioelectrical signals.

In some embodiments, the present disclosure relates to method ofmonitoring sleep patterns of a user, comprising: providing aninteractive system; collecting the digital bioelectrical signals of theuser with the bioelectrical signal acquisition device when the usersleeps or prepares to fall asleep; and processing the digitalbioelectrical signals with the computational unit to monitor the sleeppatterns of the user.

In some embodiments, the present disclosure relates to a method ofhuman-computer interaction using an interactive system, comprising:providing a signal sequence to the user; recording digital bioelectricalsignals from the user's head using a bioelectrical signal acquisitiondevice; processing the digital bioelectrical signals and identifying theexistence and the pattern of ocular event-related potentials (o-ERPs);and taking one or more actions based on the existence and the patternsof the o-ERPs.

In some embodiments, the present disclosure relates to a method ofdetecting o-ERPs, comprising: recording digital bioelectrical signalsfrom the user's head using a bioelectrical signal acquisition device;and processing the digital bioelectrical signals with a computationalunit and identifying the existence and the pattern of o-ERPs.

Additional features will be set forth in part in the description whichfollows, and in part will become apparent to those skilled in the artupon examination of the following and the accompanying drawings or maybe learned by production or operation of the examples. The features ofthe present disclosure may be realized and attained by practice or useof various aspects of the methodologies, instrumentalities andcombinations set forth in the detailed examples discussed below.

BRIEF DESCRIPTION OF THE DRAWINGS

The devices, systems, methods, and/or programming described herein arefurther described in terms of exemplary embodiments. These exemplaryembodiments are described in detail with reference to the drawings.These embodiments are non-limiting exemplary embodiments, in which likereference numerals represent similar structures throughout the severalviews of the drawings, and wherein:

FIGS. 1A-1G show different views of an exemplary bioelectrical signalacquisition device according to some embodiments of the presentdisclosure; FIG. 1A is a perspective view thereof; FIG. 1B is a bottomplanform view thereof; FIG. 1C is a top planform view thereof; FIG. 1Dis a first side view thereof; FIG. 1E is a second side view thereof;FIG. 1F is a first end view thereof; FIG. 1G is a second end viewthereof.

FIG. 2 is a schematic diagram illustrating an exemplary bioelectricalsignal acquisition device according to some embodiments of the presentdisclosure when the device is being worn on a user's head.

FIG. 3A-3D are diagrams illustrating positioning of the referenceelectrode around a user's ear according to some embodiments of thepresent disclosure; FIG. 3A shows a side view of the a user's ear whenthe reference electrode is positioned above the user's ear; FIG. 3Bshows a back view of the user's ear and head when the referenceelectrode is positioned above a user's ear; FIG. 3C shows a sectionalview of the reference electrode and the headband; FIG. 3D shows a sideview of the a user's ear when the reference electrode is positioned overthe user's ear.

FIGS. 4A-4D are schematic diagrams illustrating an interactive systemaccording to some embodiments of the present disclosure; FIG. 4A is ablock diagram showing that the interactive system includes thebioelectrical signal acquisition device, a computational unit, and anotice unit according to some embodiments of the present disclosure;FIG. 4B is a diagram showing that in the interactive system according tocertain embodiments of the present disclosure, where the computationalunit and the bioelectrical signal acquisition device may be integrated;FIG. 4C is a diagram showing that in the interactive system according tocertain embodiments of the present disclosure, where the computationalunit is a generic microcontroller; FIG. 4D is a diagram showing that inthe interactive system according to certain embodiments of the presentdisclosure, where the computational unit is a separate computing device.

FIGS. 5A-5B are schematic diagrams illustrating the interactive systemand the bioelectrical signal acquisition device in more detail accordingto some embodiments of the present disclosure; FIG. 5A shows simplifiedand basic wiring of an interactive system including wired connectionwith the notice unit; FIG. 5B shows simplified and basic wiring of aninteractive system including wireless connection with the notice unit.

FIGS. 6A-6C show records of digital bioelectrical signals collected froma user's head by the bioelectrical signal acquisition device accordingto some embodiments of the present disclosure; FIG. 6A show varioustypes of brainwave data acquired by the bioelectrical signal acquisitiondevice according to some embodiments of the present disclosure; FIG. 6Bshows a frequency-domain signal presentation of a user before, duringand after a sleep onset process by the bioelectrical signal acquisitiondevice according to some embodiments of the present disclosure; FIG. 6Cshows a frequency-domain signal presentation of a user during a fullnight of sleep by the bioelectrical signal acquisition device accordingto some embodiments of the present disclosure.

FIG. 7 is a flowchart illustrating an exemplary process forhuman-computer interaction according to some embodiments of the presentdisclosure.

FIGS. 8A-8C show an exemplary process of human-computer interaction andthe recorded signals according to some embodiments of the presentdisclosure; FIG. 8A is a flowchart of the process according to someembodiments of the present disclosure; FIG. 8B is time-domain signalpresentation, or wave chart; FIG. 8C shows a frequency-domainpresentation, or a spectrogram.

FIG. 9A-9E show an exemplary process of human-computer interaction andthe recorded signals according to some embodiments of the presentdisclosure; FIG. 9A is a flowchart of the process according to someembodiments of the present disclosure; FIG. 9B shows an audio templateat a pace of twice per second; FIG. 9C is time-domain signalpresentation, or wave chart, with sequence of synchronized o-ERPs; FIG.9D shows a frequency histogram with a peak at 2 Hz; FIG. 9E shows afrequency-domain presentation, or a spectrogram, with a bright spot at 2Hz.

FIGS. 10A-10B show an exemplary audio signal template (FIG. 10A), adigital bioelectrical signal recording (FIG. 10B) in response to theaudio signal template, and a corresponding result chart (FIG. 10C) ofthe digital bioelectrical signal recording, according to someembodiments of the present disclosure.

FIGS. 11A-11D show various exemplary audio signal templates according tosome embodiments of the present disclosure.

FIGS. 12A-12C shows an exemplary process of human-computer interactionand the recorded digital bioelectrical signals collected from a user'shead by the bioelectrical signal acquisition device according to someembodiments of the present disclosure; FIG. 12A is a flowchart of theprocess according to some embodiments of the present disclosure; FIG.12B is time-domain signal presentation, or wave chart; FIG. 12C providesan alternative process similar to the process shown in FIG. 12A.

FIGS. 13A-13B show an exemplary process of human-computer interactionand the recorded digital bioelectrical signals collected from a user'shead by the bioelectrical signal acquisition device according to someembodiments of the present disclosure; FIG. 13A is a flowchart of theprocess according to some embodiments of the present disclosure; FIG.13B is time-domain signal presentation, or wave chart.

FIG. 14 is a flowchart showing an exemplary process of human-computerinteraction according to some embodiments of the present disclosure.

FIG. 15 is a flowchart showing an exemplary process of human-computerinteraction according to some embodiments of the present disclosure.

FIG. 16 is a flowchart showing an exemplary process of human-computerinteraction according to some embodiments of the present disclosure.

FIG. 17 is a flowchart showing an exemplary process of human-computerinteraction according to some embodiments of the present disclosure.

DETAILED DESCRIPTION

In the following detailed description, numerous specific details are setforth by way of examples in order to provide a thorough understanding ofthe relevant teachings. However, it should be apparent to those skilledin the art that the present disclosure may be practiced without suchdetails. In other instances, well known methods, procedures, systems,components, and/or circuitry have been described at a relatively highlevel, without detail, in order to avoid unnecessarily obscuring aspectsof the present disclosure.

The present disclosure describes bioelectrical signal acquisitiondevices, interactive system, as well as methods for collecting,measuring, recording, analyzing, and utilizing bioelectrical signalsfrom biological beings, including but not limited to human subjects. Insome embodiments, the devices, systems, and methods herein described canbe used in studying, analyzing, and manipulation of physical conditionsand functions. For example, the devices, systems, and methods hereindescribed can be used to study and intervene with sleep and functionsassociated with sleep, such as but not limited to sleep onset, sleepdepth, sleep dynamics, dream, memory consolidation, physical recovery,insomnia, sleep apnea, narcolepsy, hypersomnia, and abnormal sleepstructure.

The devices, systems and methods herein disclosed may also be used tostudy and modulate a user's mental status, such as but not limited toanxiety, depression, attention deficiency, stress and meditation. Thedevices, systems and methods herein disclosed may be convenient andeffective tools to assess the effectiveness of sleep treatments,pharmaceutical, physical, cognitive or behavioral. They may also be usedin neurofeedback to intervene and make adjustments based on the user'sneurological and mental conditions. They can be used as a two-waycommunication system allowing the user in certain physiologicalconditions, such as dream state or in pseudo-coma, also known as“locked-up syndrome”, to send signal voluntarily with specific eyemovements so that he or she can effectively interact with thesurrounding environment.

The present disclosure also relates to the ornamental design for abioelectrical signal acquisition device or a portion thereof, as shownand described in association with the Figures.

These and other features, and characteristics of the present disclosure,as well as the methods of operation and functions of the relatedelements of structure and the combination of parts and economies ofmanufacture, may become more apparent upon consideration of thefollowing description with reference to the accompanying drawings, allof which form a part of this disclosure. It is to be expresslyunderstood, however, that the drawings are for the purpose ofillustration and description only and are not intended to limit thescope of the present disclosure. It is understood that the drawings arenot to scale.

The flowcharts used in the present disclosure illustrate operations thatsystems implement according to some embodiments in the presentdisclosure. It is to be expressly understood that the operations of theflowchart may be implemented not in order. Conversely, the operationsmay be implemented in inverted order, or simultaneously. Moreover, oneor more other operations may be added to the flowcharts. One or moreoperations may be removed from the flowcharts.

In the present disclosure, the term “bioelectrical signal” refers toelectric signals produced by biological beings, such as but not limitedto plants and animals. In some embodiments, the bioelectrical signals ofthe present disclosure are produced by a human subject.

In the present disclosure, the term “user” refers to a subject using thebioelectrical signal acquisition device and/or the interactive system ofthe present disclosure. Here “using” means wearing and/or being tested,monitored or analyzed. In some embodiments, the user is a human being.In some embodiments, the user is an animal other than a human being. Insome embodiments, the bioelectrical signal acquisition device isconfigured to be worn on the user's head. In some embodiments, thebioelectrical signal acquisition device is configured to be worn onother body parts, such as but not limited to chest, leg, foot, arm,hand, neck, shoulder, hip, and back. In some embodiments, the user is amale or a female. In some embodiments, the user is a newborn, an infant,a toddler, a child, a teenager, a young adult, an adult, or a senior.

In the present disclosure, the bioelectrical signal acquisition device,the interactive system, and the methods herein disclosed are used totest, monitor, and/or analyze certain physiological or pathologicalconditions and/or functions. In some embodiments, the bioelectricalsignal acquisition device, the interactive system, and the methodsherein disclosed are used to test, monitor, and/or analyze sleep andrelated conditions and/or functions.

In the present disclosure, the term “sleep” or “asleep” refers to acondition of body and mind such as that which typically recurs forseveral hours every night, in which the nervous system is relativelyinactive, the eyes closed, the postural muscles relaxed, andconsciousness practically suspended. The devices, systems, and methodsof the present disclosure can be used for collecting, monitoring, andanalyzing digital bioelectrical signals from a user when the user issleeping or in a sleep-related stage. In certain embodiments, the useris preparing to fall asleep. In certain embodiments, the user is asleep.In certain embodiments, the user is experiencing different stages ofsleeping, including but not limited to stage 1 sleep, stage 2 sleep,stage 3 sleep, and rapid eye movement (REM) sleep. In certainembodiments, the user is in an awake stage (wake up time in the morning)immediately after a period of sleep. In certain embodiments, the user isin an awake stage between two close periods of sleep. In someembodiments, the user goes through a duration that combines some or allof the stages related to sleep.

FIGS. 1A-1G show different views of an exemplary bioelectrical signalacquisition device 20 according to some embodiments of the presentdisclosure.

As shown in FIG. 1A, which is a perspective view, the bioelectricalsignal acquisition device 20 includes a headband 21, a sensing electrode23 attached to the headband 21, a grounding electrode 25 attached to theheadband 21, two reference electrodes 24 attached to the headband 21, aprocessing unit 26 attached to the headband 21, and attachment elements27 a and 27 b (referring to FIG. 1C).

As shown in FIG. 1B, which is a bottom planform view, and FIG. 1C, whichis a top planform view, the bioelectrical signal acquisition device 20includes a headband 21, a sensing electrode 23, a grounding electrode25, two reference electrodes 24, a processing unit 26, and attachmentelements 27 a and 27 b. As used here, the bottom planform view shows aside the headband 21 that is in contact with a user's body part (e.g.,head) when the bioelectrical signal acquisition device 20 is being worn;and the top planform view shows a side of the headband 21 that is not incontact (or at least not in full contact) with the user's body part whenthe bioelectrical signal acquisition device 20 is being worn.

As supplements to FIGS. 1A, 1B, and 1C, FIGS. 1D-1G are other views ofthe bioelectrical signal acquisition device 20. In particular, FIG. 1Dshows a first side view of the bioelectrical signal acquisition device20 and FIG. 1E shows a second side view of the bioelectrical signalacquisition device 20. As shown in FIGS. 1D and 1E, the bioelectricalsignal acquisition device 20 includes a headband 21, a sensing electrode23, a grounding electrode 25, two reference electrodes 24, a processingunit 26, and attachment elements 27 a and 27 b. FIG. 1F shows a firstend view of the bioelectrical signal acquisition device 20, and FIG. 1Gshows a second end view of the bioelectrical signal acquisition device20.

FIG. 2 is schematic diagram illustrating an exemplary bioelectricalsignal acquisition device 20 according to some embodiments of thepresent disclosure when the device is being worn by a human user 60 onthe user's head 62. In the particular configuration shown in FIG. 2, thebioelectrical signal acquisition device 20 is worn in a manner that thedistal ends of the headband 21 are attached to each other, the headband21 is wrapped around the user's head 62, the sensing electrode 23contacts the skin on the forehead of the user, the sensing groundingelectrode 25 contacts the skin on the forehead of the user (referring toFIG. 4A), and the reference electrode 24 contacts the skin above an ear63 of the user 60. It should be noted, however, that there are morepositioning possibilities for the electrodes, as well as different waysto wear the bioelectrical signal acquisition device 20; and part of thepositioning options and various ways of wearing are described anddiscussed below (e.g., in combination with the illustrations shown inFIGS. 3A-3D).

The various parts of the bioelectrical signal acquisition device 20serve various functions. However, it should be noted that the embodimentof the bioelectrical signal acquisition device 20 shown in FIGS. 1A-1Gand 2 provides only some of the product designs envisioned in thepresent disclosure. Other alternative product designs, without departingfrom the descriptions herein provided or general principles of scienceand engineering, should also be considered part of the presentinvention.

Referring to FIGS. 1A-1G, the bioelectrical signal acquisition device 20includes a headband 21 configured to be wearable around a user's head.For a more detailed illustration, refer to FIG. 2. The headband 21generally refers to a band-shaped flat body to which various electronicelements (e.g., the electrodes, wires, and processing unit) can beattached in different manners. In some embodiments, the headband 21includes a single piece of band material to which the electronicelements are attached. For example, wires connecting the electrodes andthe processing unit can be buried and/or sewed in the headband 21; theelectrodes can be integrated into the headband 21. In some embodiments,the headband 21 includes more than one piece of material, whereas thepieces are connected by the electronic elements. For example, in certainembodiments, one or more electrodes (e.g., the reference electrodes 24or the sensing electrode 23) can connect different pieces of theheadband 21 so that other electronic elements may be attached thereto.

The headband 21 may be made from various types of materials. In someembodiments, the headband 21 is made from a soft material, configured toprovide comfort when the bioelectrical signal acquisition device 20 isbeing worn and not disturb the user when the user sleeps or prepares tofall asleep. In some embodiments, the headband 21 is made from anelastic material, configured to provide a balance of flexibility andtightness so that when the bioelectrical signal acquisition device 20 isbeing worn the user feels comfortable and the bioelectrical signalacquisition device 20 can stay in place when the user sleeps or preparesto fall asleep. The headband 21 may be made with one or more types ofmaterials, including but not limited to: rubber or stretchable synthetic(e.g., spandex) materials, rubber or stretchable synthetic cores thatare bound or wrapped in polyester, cotton, nylon, neoprene, or a blendof fiber threads, etc.

Referring to FIGS. 1A-1G and FIG. 2, the bioelectrical signalacquisition device 20 includes a sensing electrode 23 and a referenceelectrode 24. In some embodiments, the sensing electrode 23 and thereference electrode 24 are configured to receive bioelectrical signalsfrom the user's head. In some embodiments, there may be more than onesensing electrode 23. In some embodiments, there may be more than onereference electrode 24. As parts of a circuit, the sensing electrode(s)23 and the reference electrode(s) 24 are configured to provide sensingsignals from the user's head.

It should be noted that the terms “sensing electrode” and “referenceelectrode” can be exchanged when referring to particular electrodes.These electrodes both provide inputs that are used in generating thesensing signals. Generally, “sensing electrode” refers to the electrodethat is positioned on the headband 21 so that it contacts the skin onthe forehead of the user when the user wears the bioelectrical signalacquisition device 20 on the user's head; “reference electrode” refersto the electrode that contacts the skin of the user when the user wearsthe bioelectrical signal acquisition device 20 on the user's head andforms a circuit with the sensing electrode. However, it should also benoted that the terms may be exchanged, as long as the electrodes servethe same functions as a combination as indicated above.

Referring to FIGS. 1A-1E, the sensing electrode 23 is made from one ormore materials that are at least partly conductive. In the embodimenthere, the sensing electrode 23 is a metal pin with one or more partsthat penetrate the flat body of the headband 21 and can be seen fromboth the top view (FIG. 1C) and the bottom view (FIG. 1B). For thebottom view (showing the side of the headband 21 contacting the user'shead), the sensing electrode 23 is exposed so that it can contact theuser's skin when the bioelectrical signal acquisition device 20 is beingworn. In certain embodiments, the sensing electrode 23 protrudes fromthe bottom surface (the surface in contact with the user's head) of theheadband 21, for example, for 1-2 mm. In certain preferred embodiments,as shown in FIGS. 1D-1E, the sensing electrode 23 does not visiblyprotrude from the bottom surface of the headband 21 but is approximatelyeven with the bottom surface. In certain embodiments, the sensingelectrode 23 does not visibly protrude from the bottom surface of theheadband 21 but sinks slightly (e.g., 0.1-1 mm) into the bottom surface.

It should be noted that there is no specific requirement as to theformat of the sensing electrode 23. For example, the sensing electrode23 can be made from other types of conductive materials (e.g., thematerials of the reference electrode 24 as describe below). As anotherexample, while the embodiments shown in FIGS. 1A-1G include one sensingelectrode 23, the number of sensing electrodes 23 may be one, two, ormore. It is only necessary that the sensing electrode(s) 23 be capableof contacting the user's skin on the forehead when the bioelectricalsignal acquisition device 20 is being worn and collecting signals fromthe user's head.

Referring to FIGS. 1A-1E, the bioelectrical signal acquisition device 20includes a grounding electrode 25. In some embodiments, the groundingelectrode 25 is configured to provide electronic grounding for thesensing signals. In the embodiments here, the grounding electrode 25 isa metal pin with one or more parts that penetrate the flat body of theheadband 21 and can be seen from both the top view (FIG. 1C) and thebottom view (FIG. 1B). For the bottom view (showing the side of theheadband 21 contacting the user's head), the grounding electrode 25 isexposed so that it can contact the user's skin when the bioelectricalsignal acquisition device 20 is being worn. In certain embodiments, thegrounding electrode 25 protrudes from the bottom surface (the surface incontact with the user's head) of the headband 21, for example, for 1-2mm. In certain preferred embodiments, as shown in FIGS. 1D-1E, thegrounding electrode 25 does not visibly protrude from the bottom surfaceof the headband 21 but is approximately even with the bottom surface. Incertain embodiments, the grounding electrode 25 does not visiblyprotrude from the bottom surface of the headband 21 but sinks slightly(e.g., 0.1-1 mm) into the bottom surface.

In some embodiments, the grounding electrode 25 is positioned on theheadband to contact the user's skin when the user wears thebioelectrical signal acquisition device 20 on the user's head. In someembodiments, the sensing electrode 23 and the grounding electrode 25 arepositioned symmetrically to a mid-line of the headband 21. In someembodiments, when the bioelectrical signal acquisition device 20 is wornby the user on the user's head, as shown in FIG. 2, the sensingelectrode 23 and the grounding electrode 25 are symmetrical of asagittal plane of the user's body. It should be noted that there is nospecific requirement that the grounding electrode 25 be shaped and/orpositioned. It is necessary that the grounding electrode 25 be capableof contacting the user's skin when the bioelectrical signal acquisitiondevice 20 is being worn, and that the grounding electrode 25 and thesensing electrode 23 are positioned apart with a sufficient distance foreffective grounding. The grounding electrode 25 can be made from othertypes of conductive materials (e.g., the materials of the referenceelectrode 24 as describe below). There may also be more than onegrounding electrode 25.

Referring to FIGS. 1A-1E, the bioelectrical signal acquisition device 20includes two reference electrodes 24. However, it should be noted thatthere may be only one reference electrode 24 and there may be more thantwo reference electrodes 24 in the bioelectrical signal acquisitiondevice 20. The reference electrode 24 is made from one or more materialsthat are at least partly conductive. In some embodiments, the referenceelectrodes 24 may include soft and conductive materials including butnot limited to conductive fibric, conductive rubber, conductive silicon,a thin layer of metal sheet, and any combinations thereof. In certainpreferred embodiment here, the reference electrodes 24 includeconductive fibric.

The reference electrodes 24 are configured and positioned to contact theuser's skin when the bioelectrical signal acquisition device 20 is beingworn on the user. In certain embodiments, the reference electrode 24 isformatted as a piece of conductive material (e.g., conductive fibric)circularly covering a segment of the headband 21. In certain preferredembodiments, the presence of the reference electrode 24 only addsslightly to the thickness of the headband 21 (the illustrations of FIGS.are not in proportion). In certain embodiments, the reference electrode24 is made from soft and flexible material to provide comfort to theuser.

It should be noted that there is no specific requirement as to theformat of the reference electrode 24. For example, in certainembodiments, the reference electrode 24 can be made from other types ofconductive materials (e.g., the materials of the sensing electrode 23 asdescribe above).

Sensing signals are produced by combining signals collected by thesensing electrode 23 and signals collected by the reference electrode24. Specifically, the DC electric potential differences, or voltage,between the sensing electrode 23 and the reference electrode 24, ismeasured multiple times (e.g., several hundred times) per second.Depending on the positioning of the electrodes, the user's physiologicalconditions (e.g., awake, sleep onset, or asleep), the sensing signalsmay include various types of signals. For example, in some embodiments,the sensing signals include electroencephalogram (EEG), electromyogram(EMG), and/or Electrooculography (EOG) signals of the user. In someembodiments, the sensing signals include primarily EEG signals. In someembodiments, the sensing signals include primarily EEG and EOG signals.

Referring to FIGS. 1A-1G and 2, the bioelectrical signal acquisitiondevice 20 includes a processing unit 26, which is configured to generatedigital bioelectrical signals based on the sensing signals. In someembodiments, the processing unit 26 includes an electrical signalamplification circuit configured to amplify the sensing signals. In someembodiments, the processing unit 26 includes an analog-to-digitalconverting circuit configured to convert analog signals to digitalsignals. Specific connections between the electrodes and the processingunit 26 may vary. The bioelectrical signal acquisition device 20 mayinclude signal wires connecting the sensing electrode 23 and thereference electrodes 24 to an input port of the signal amplificationcircuit of the processing unit 26. In some embodiments, at least aportion of the wires are shielded wires comprising a shielding layer,and the shielding layer is connected to the grounding electrode

Besides signal conversion and processing, the processing unit 26 mayperform other functions. For example, the processing unit 26 may includea transmission element configured to transmit signals to other devicesor units (e.g., a computational unit), via wired or wirelesstransmission (e.g., WIFI or BLUETOOTH). In certain embodiments, thetransmission element is physically integrated into the processing unit26. In certain embodiments, the transmission element is a separatestructure from the processing unit 26. In some embodiments, theprocessing unit 26 may also be configured receive incoming data andintegrate the incoming data with the sensing signals or the digitalbioelectrical signals.

Referring to FIGS. 1A-1G and 2, the bioelectrical signal acquisitiondevice 20 includes connecting elements 27 a and 27 b, which areconfigured to connect two distal ends of the headband 21 to form acircle. In some embodiments, the connecting elements 27 a and 27 b areconfigured to be capable of adjusting the circumference of the circle sothat the bioelectrical signal acquisition device 20 can be properlywrapped around a user's head. Here, “properly wrapped” means a balanceof comfort (to reduce disturbance to the user) and tightness (to ensureeffective signal collection in a long period of time). The connectingelements of 27 a and 27 b can be any format or materials, such as butnot limited to hook-and-loop fasteners, snap buckle straps, and spacedbutton pairs. It should also be noted that

The distances between the electrodes and the size of the electrodes mayvary. Referring to FIGS. 1B and 1C, in some embodiments, the distancebetween the centers of the grounding electrode 25 and the sensingelectrode 23, marked as AA′, may be in a range of 5-30 cm; in certainembodiments, AA′ may be in a range of 5-10 cm; in certain embodiments,AA′ may be in a range of 7-10 cm; In certain embodiments, AA′ may be ina range of 7-8 cm. Referring to FIGS. 1B and 1C, in some embodiments,the distance between a center line of the headband 21 and the center ofthe reference electrode 24, marked as BB′, may be in a range of 5-30 cm;in certain embodiments, BB′ may be in a range of 10-25 cm; in certainembodiments, BB′ may be in a range of 12-20 cm; in certain embodiments,BB′ may be in a range of 15-18 cm, in certain embodiments, BB′ may be ina range of 16-17 cm. Referring to FIGS. 1B and 1C, in some embodiments,the length of the reference electrode 24 along the length of theheadband 21, marked as CC′, may be in a range of 1-10 cm; in certainembodiments, CC′ may be in a range of 2-8 cm; in certain embodiments,CC′ may be in a range of 4-6 cm; in certain embodiments, CC′ may bearound 5 cm. In some embodiments, a larger (e.g., longer in thelongitudinal direction of the headband 21) reference electrode 24 mayallow for more flexible arrangement for the user to choose how to wearthe bioelectrical signal acquisition device 20. However, this possiblebenefit needs to be balanced with cost of material and effectiveness ofsignal collection.

As shown in FIGS. 1A, 1D, 1E and 2, the processing unit 26 may include apower switch 261 and a charging port 262. In some embodiments, the powerswitch 261 is configured to control on/off state of the processing unit26, as well as on/off state of certain functions of the processing unit26, such as but not limited to signal transmission. In some embodiments,the charging port 262 is configured to be used to charge the processingunit 26. In certain embodiments, the charging port 262 may also beconfigured to send data to or receive data from other devices or units.

Referring to FIGS. 1A-1G and 2, the bioelectrical signal acquisitiondevice 20 may be configured to produce digital bioelectrical signals ofa user when the user sleeps or prepares to fall asleep. In someembodiments, the headband 21 is made from soft and elastic material andconfigured to not disturb the user when the user sleeps or prepares tofall asleep. In some embodiments, the signal wires are integrated in theheadband 21 and configured to not disturb the user when the user sleepsor prepares to fall asleep. In some embodiments, the electrodes arestructured and positioned to not the user when the user sleeps orprepares to fall asleep. In some embodiments, the digital bioelectricalsignals comprise electroencephalogram (EEG), electromyogram (EMG),and/or Electrooculography (EOG) signals of the user when the user sleepsor prepares to fall asleep. In some embodiments, the digitalbioelectrical signals comprise primarily EEG signals of the user whenthe user sleeps or prepares to fall asleep. In some embodiments, thedigital bioelectrical signals comprise EEG and EOG signals of the userwhen the user sleeps or prepares to fall asleep.

FIG. 3A-3D are diagrams illustrating positioning of the referenceelectrode around a user's ear according to some embodiments of thepresent disclosure. FIG. 3A shows a side view of a user's ear 63 whenthe reference electrode 24 is positioned above the user's ear 63. FIG.3B shows a sectional view of the user's ear 63 and head when thereference electrode 24 is being positioned above a user's ear 63.

As shown in FIGS. 2, 3A, and 3B, in certain embodiments, one of thepossible position combinations of the electrodes when the bioelectricalsignal acquisition device 20 is being worn is that the sensing electrode23 is contacting the skin on the forehead of the user's head 62, and thereference electrodes 24 are contacting the skin above the ear 63 of theuser's head 62. In particular, referring to FIGS. 3A and 3B, thereference electrode 24 is positioned, at least in part, behind a toppart of the ear helix 64. In other words, the reference electrode 24 ispartly positioned between the top part of the ear helix 64 and the headof the user. The style shown in FIGS. 2, 3A, and 3B, with minormodifications (e.g., slightly highly or lower) is the most common stylefor wearing any headband-type device.

FIG. 3C shows a sectional view of the reference electrode 24 and theheadband 21 at the location marked as DD′ in FIG. 3A. FIG. 3Cdemonstrates that the headband 21 is covered by the reference electrode24, which is connected to a wire 81. It should be noted that FIG. 3C isnot in proportion. For clarity purposes, the space between the headband21 and the reference electrode 24 is exaggerated.

As shown in FIG. 3C, with a rough division as shown with dotted lines,the headband 21 has a bottom side 211, defined as the side facing theuser's head 62 when the user wears the bioelectrical signal acquisitiondevice 20, and a top side 212, defined as side facing away from theuser's head 62 when the user wears the bioelectrical signal acquisitiondevice 20; between the bottom side 211 and the top side 212 is an upperedge 214, which points up when the user stays upright, and a lower edge213, which points down, when the user wears the bioelectrical signalacquisition device 20. As shown in FIG. 3C, with the rough division asshown with dotted lines, the bottom side 211 can be divided into anupper portion 211 a, a middle portion 211 b, and a lower portion 211 c;similarly, the top side 212 can be divided into an upper portion 212 a,a middle portion 212 b, and a lower portion 212 c.

As a general design, in some embodiments, the sensing electrode 23 ispositioned on the headband 21 to contact the skin on the forehead of theuser, and the reference electrode 24 is positioned on the headband tocontact the skin on, over, above, behind, or around an ear of the user,when the user wears the bioelectrical signal acquisition device 20 onthe user's head. In addition, as indicated above, the terms referenceelectrode 24 and sensing electrode 23 can be exchanged. Therefore, insome embodiments, the sensing electrode 23 is positioned on the headband21 to contact the skin on, over, above, behind, or around an ear of theuser, and the reference electrode 24 is positioned on the headband 21 tocontact the skin on the forehead of the user, when the user wears thebioelectrical signal acquisition device on 20 the user's head.Therefore, the descriptions herein provided for the sensing electrode 23and the reference electrode 24 can also be exchanged.

In some embodiments, referring to FIG. 3A, the user has hair 66 abovethe user's ear 63. The hair 66 in some cases would be an obstacle thatmay block the reference electrode 24 from properly contacting the user'sskin, making signal collection more difficult. However, as long as partof the reference electrode 24 can contact a sufficient area of theuser's skin, even if the other part of the reference electrode 24 isblocked, signal collection would still be possible. Whether a partialblockade by hair would be problematic depends on the length andthickness of the hair and positioning of the bioelectrical signalacquisition device 20. Since the skin close to the connecting part ofthe head and the ear is less likely to be covered by hair, certaindesigns and positioning of the reference electrode 24 aim to minimizethe chance of hair blockade. In addition, the designs and positioning ofthe reference electrode 24 aim to improve the chance of effective signalcollection when the bioelectrical signal acquisition device 20 is beingworn, not only in the way shown in FIG. 3B, but also in other way, wherevarious ways of wearing the bioelectrical signal acquisition device 20are accorded different weights due to the likelihood of being used.

In some embodiments, the reference electrode 24 covers at least a lowerportion 211 c of the bottom side 211 of a segment of the headband 21,thus improving the chance of effective signal collection. In someembodiments, the reference electrode 24 covers at least a lower edge 213of a segment of the headband 21, thus improving the chance of effectivesignal collection. In some embodiments, the reference electrode 24covers at least a lower portion 211 c of the bottom side 211 and a loweredge 213 of a segment of the headband 21, thus improving the chance ofeffective signal collection. In some embodiments, the referenceelectrode 24 covers at least a middle portion 211 b of the bottom side211, a lower portion 211 c of the bottom side 211, and a lower edge 213,of a segment of the headband 21, thus improving the chance of effectivesignal collection. In some embodiments, the reference electrode 24covers at least a lower portion 211 c of the bottom side 211, a lowerportion 212 c of the top side 212, and a lower edge 213, of a segment ofthe headband 21, thus improving the chance of effective signalcollection. In some embodiments, the reference electrode 24 covers anentire bottom side 211 and a lower edge 213 of a segment of the headband21, thus improving the chance of effective signal collection. In someembodiments, the reference electrode 24 encircles a segment of theheadband 21, thus improving the chance of effective signal collection.

While it is a common way to wear the bioelectrical signal acquisitiondevice 20 as shown in FIGS. 2, 3A and 3B, there are various otherpossibilities, one of which is illustrated in FIG. 3D, which shows aside view of a user's ear 63 when the reference electrode 24 is beingworn over the user's ear 62. In this style, except for very limitedsituations, there is no “hair blockade” problem. As long as thereference electrode 24 covers at least part of the bottom side 211 of asegment of the headband 21, the reference electrode 24 can properlycontact the skin of the user and collect usable signals. FIG. 3Dillustrates the versatility in using the bioelectrical signalacquisition device 20 of the present disclosure. The design and/orpositioning the electrodes improve the overall likelihood of monitoringa user's physiological conditions (e.g., sleep) with both comfort andeffectiveness for a long period of time.

One of the key difficulties and a long-felt but unsolved need related towearable electronic devices, especially devices for sleep monitoring, isthe balance between comfort and effectiveness. When the wearable deviceis used for sleep monitoring for a relatively long period of time (e.g.,several hours), it needs to be sufficiently comfortable so that it doesnot disturb the user when the user sleeps or tries to fall asleep. Inaddition, it also needs to be effective in collecting bioelectricalsignals for a long period of time; specifically, the electrodes mustproperly contact the skin of the user, and the bioelectrical signalacquisition device needs to tight or stable enough when being worn sothat it does not fall off or become displaced because falling off ordisplacement would make signal collection difficult or impossible. Thetwo requirements are somewhat contradictory, but the current disclosureaim to find a balance and satisfy both requirements.

In the present disclosure, certain factors/designs may contribute to thecomfort when wearing the device. Such factors/designs include but arenot limited to the following: the headband 21 may be made from softmaterial; the electrodes (e.g., the sensing electrode 23, the groundingelectrode 25, and the reference electrodes 24) do not protrude out ofthe headband 21; some electrodes (e.g., the sensing electrode 23, thegrounding electrode 25, and the reference electrodes 24) may be madefrom soft material (e.g., conductive fibric); the reference electrodes24 may be made from soft material, such as conductive fibric, wavedmetal fiber, conductive silicon, conductive rubber or a thin layer ofmetal sheet; the tightness of the headband 21 can be adjusted; theelectrodes are strategically positioned and designed to allow the userto choose his/her own comfortable ways to wear the device from variouspossibilities (one example being the positioning and design of thereference electrodes 24). It should also be noted that in certainembodiments these factors do not necessarily to be all included toachieve the stated goal.

In the present disclosure, certain factors/designs may contribute to theeffectiveness of the bioelectrical signal acquisition device 20 when itis being worn. Such factors/designs include but are not limited to thefollowing: the headband 21 may be made from elastic material, allowingfor proper wrapping of the headband 21 around the user's head; properconfiguration of the electrodes (e.g., the sensing electrode 23, thegrounding electrode 25, and the reference electrodes 24), allowing foreffective collection of the sensing signal; the electrodes arestrategically positioned and designed to allow for prolonged contactwith the user's skin (one example being the position and design of thereference electrode 24). It should also be noted that in certainembodiments these factors do not necessarily to be all included toachieve the stated goal.

FIGS. 4A-4D are schematic diagrams illustrating an interactive system 50according to some embodiments of the present disclosure. In someembodiments, the interactive system 50 aims to collect, monitor,process, analyze, and/or transmit bioelectric signals from a subject(e.g., human subject). In some embodiments, the interactive system 50aims to interact with the subject. In some embodiments, the interactivesystem 50 aims to influence and/or modulate certain physical orpathological condition of the subject. In some embodiments, the subjectis a subject using the bioelectrical signal acquisition device 20. Insome embodiments, the interactive system 50 includes the bioelectricalsignal acquisition device 20 and the computational unit 31, without thenotice unit 11. In certain embodiments, the interactive system 50include the bioelectrical signal acquisition device 20, thecomputational unit 31, and the notice unit 11. FIGS. 4B-4D provideexamples for the interactive system 50 shown in FIG. 4A.

FIG. 4A is a block diagram showing that the interactive system 50 mayinclude the bioelectrical signal acquisition device 20, a computationalunit 31, and a notice unit 11 according to some embodiments of thepresent disclosure. In some embodiments, the bioelectrical signalacquisition device 20 may include the headband 21, the electrodes(sensing electrode 23, grounding electrode 25, and reference electrode24), and the processing unit 26, as shown in FIGS. 1A-1G, 2, and 3A-3D.

As shown in FIG. 4A, the interactive system 50 may include acomputational unit 31, which may be configured to receive the digitalbioelectrical signals from the bioelectrical signal acquisition device20. The computational unit 31 may be any part, component, processor,board, device, apparatus or system that are have computational andprocessing capabilities. In some embodiments, the computational unit 31includes a generic microprocessor. In some embodiments, thecomputational unit 31 includes a specialized microprocessor. In someembodiments, the computational unit 31 includes part or all of anintegrated computing device, such as but not limited to a desk topcomputer, a laptop computer, a tablet, and a smart phone.

In some embodiments, the computational unit 31 is configured to processand analyze the digital bioelectrical signals provided by thebioelectrical signal acquisition device 20. In some embodiments, thecomputational unit 31 is configured to generate instructions and/orfeedbacks to the bioelectrical signal acquisition device 20 based onpre-determined programs. In some embodiments, the computational unit 31is configured to generate instructions and/or feedbacks to thebioelectrical signal acquisition device 20 based on pre-determinedprograms and the digital bioelectrical signals provided by thebioelectrical signal acquisition device 20. In some embodiments, thecomputational unit 31 is configured to generate instructions and/orfeedbacks to a notice unit 11 based on pre-determined programs. In someembodiments, the computational unit 31 is configured to generateinstructions and/or feedbacks to the notice unit 11 based onpre-determined programs and the digital bioelectrical signals providedby the bioelectrical signal acquisition device 20.

As shown in FIG. 4A, according to some embodiments of the presentdisclosure, the interactive system 50 may include a notice unit 11,which is configured to facilitate interaction with the subject. Forexample, the notice unit 11 may be used to send and/or receive signalsto and/or from the subject. Such signals may include but be not limitedto: visual signals auditory, or sound-based signals; chemical signals(e.g., with perfume or pheromones), and tactile, or touch-based signals,or any combination thereof. In some embodiments, the subject is a humansubject using the bioelectrical signal acquisition device 20.

In some embodiments, the notice unit 11 may be configured to receiveinstructions from the bioelectrical signal acquisition device 20 and/orthe computational unit 31 to send signals to the subject. In certainembodiments, the notice unit 11 includes a visual medium (e.g., a screenor a piece of paper) that is configured to present visual signals to thesubject. In certain embodiments, the notice unit 11 includes a tactiledevice that can send touch-based signals (e.g., vibration) to the user.In certain embodiments, the notice unit 11 includes an audio device (insuch cases the notice unit 11 may be considered an audio unit)configured to send audio signals (i.e., play audio) to the subject.

In some embodiments, the notice unit 11 may be configured to receivesignals from the subject. For example, the notice unit 11 may receiveaudio signals (or other types of signals) directly from the user whenthe user speaks or make other types of sound. In some embodiments, thenotice unit 11 does not receive signals directly from the subject, butonly receive instructions from the computational unit 31, whichprocesses signals from user, such as but limited to the digitalbioelectrical signals collected by the bioelectrical signal acquisitiondevice 20 from the subject (user of the bioelectrical signal acquisitiondevice 20).

In some embodiments, the bioelectrical signal acquisition device 20, thecomputational unit 31, and the notice unit 11 are physically separatedevices. For example, the computational unit 31 can be a desk computer,the notice unit 11 can be one or more speakers, and the bioelectricalsignal acquisition device 20 can be a separate device as shown in FIGS.1A-1G. In some embodiments, the bioelectrical signal acquisition device20 and the computational unit 31 are integrated together, while thenotice unit 11 is a physically separate device. For example, thecomputational unit 31 can be a microprocessor integrated into thebioelectrical signal acquisition device 20, e.g., combined with theprocessing unit 26 of the bioelectrical signal acquisition device 20. Insome embodiments, the computational unit 31 and the notice unit 11 areintegrated together, while the bioelectrical signal acquisition device20 is a physically separate device. For example, the computational unit31 can be a small phone or tablet, and the notice unit 11 may be theaudio and/or display part of the smart phone or tablet, and thebioelectrical signal acquisition device 20 can be a separate device asshown in FIGS. 1A-1G. In some embodiments, the bioelectrical signalacquisition device 20 and the notice unit 11 are integrated together,while the computational unit 31 is a physically separate device. Forexample, the notice unit 11, as an audio player or tactile device, canbe built into the bioelectrical signal acquisition device 20, e.g.,together with the reference electrode 24 or the processing unit 26. Insome embodiments, the bioelectrical signal acquisition device 20, thecomputational unit 31, and the notice unit 11 are a single physicallyintegrated device. For example, the computational unit 31 can bemicroprocessor integrated into the bioelectrical signal acquisitiondevice 20, e.g., combined with the processing unit 26, and the noticeunit 11, as an audio player or tactile device, can be integrated intothe headband 21 close to or within the reference electrode 24.

The bioelectrical signal acquisition device 20, the computational unit31, and the notice unit 11 can communicate with or without wire. Forexample, the bioelectrical signal acquisition device 20 can transmitsignals to the computational unit 31 through wire or wirelessly, e.g.,with WIFI or BLUETOOTH. As another example, the computational unit 31can transmit instructions to the notice unit 11 through wire orwirelessly, e.g., with WIFI or BLUETOOTH.

FIG. 4B is a diagram showing that in the interactive system 50 accordingto certain embodiments of the present disclosure, where thecomputational unit 31 and the bioelectrical signal acquisition device 20are integrated. As shown in FIG. 4B, in certain embodiments, thebioelectrical signal acquisition device 20 may be a single-channeldevice (e.g., a single-channel EEG device), the computational unit 31may be a microcontroller, and the notice unit 11 may be one or morewired audio earplugs connected to the microcontroller by cable. Incertain embodiments, the bioelectrical signal acquisition device 20 andthe computational unit 31 (microcontroller) are integrated in the samephysical structure. It should be noted, as indicated above, that thecomputational unit 31 and/or the bioelectrical signal acquisition device20 can be connected to the notice unit 11 wirelessly, e.g., through WIFIor BLUETOOTH.

FIG. 4C is a diagram showing that in the interactive system according tocertain embodiments of the present disclosure, where the computationalunit 31 is a generic microcontroller. As shown in FIG. 4C, in certainembodiments, the bioelectrical signal acquisition device 20 may be asingle-channel device (e.g., a single-channel EEG device), thecomputational unit may be a generic microcontroller, such as but notlimited to an “ARDUINO UNO”, and the notice unit 11 may be one or morewired audio speakers connected to the microcontroller by cable. Incertain embodiments, the bioelectrical signal acquisition device 20 andthe computational unit 31 (microcontroller) are separate physicalstructures. In certain embodiments, the bioelectrical signal acquisitiondevice 20 also includes a wireless transmitting component that operablycommunicates with the computational unit 31. In certain embodiments, thewireless transmission is carried out by WIFI or BLUETOOTH. It should benoted, as indicated above, that the computational unit 31 and/or thebioelectrical signal acquisition device 20 can be connected to thenotice unit 11 wirelessly, e.g., through WIFI or BLUETOOTH.

FIG. 4D is a diagram showing that in the interactive system according tocertain embodiments of the present disclosure, where the computationalunit 31 is a separate computing device. As shown in FIG. 4D, in certainembodiments, the bioelectrical signal acquisition device 20 may be asingle-channel device (e.g., a single-channel EEG device), thecomputational unit may be a desktop computer, a laptop computer, atablet computer, or a smart phone, and the notice unit 11 may be anaudio headset connected to the microcontroller wirelessly. In certainembodiments, the bioelectrical signal acquisition device 20 and thecomputational unit 31 are separate physical structures. In certainembodiments, the bioelectrical signal acquisition device 20 alsoincludes a wireless transmitting component that operably communicateswith the computational unit 31. In certain embodiments, the wirelesstransmission is carried out by WIFI or BLUETOOTH. It should be noted, asindicated above, that the computational unit 31 and/or the bioelectricalsignal acquisition device 20 can be connected to the notice unit 11 withwire.

FIGS. 5A-5B are schematic diagrams illustrating the interactive system50 and the bioelectrical signal acquisition device 20 in more detailaccording to some embodiments of the present disclosure, where thecomputational unit 31 and the bioelectrical signal acquisition device 20are integrated.

FIG. 5A shows simplified and basic wiring of an interactive system 50including wired connection with the notice unit 11. As shown in FIG. 5A,the bioelectrical signal acquisition device 20 includes a sensingelectrode 23, a reference electrode 24, a grounding electrode 25, aprocessing unit 26, all attached to a headband 21. In certainembodiments, the processing unit 26 includes a processing board as shownin FIG. 5A. In certain embodiments, the bioelectrical signal acquisitiondevice 20 may be a single-channel device, the computational unit 31 maybe a microcontroller, and the notice unit 11 may be one or more wiredaudio earplugs connected to the microcontroller by cable. In certainembodiments, the bioelectrical signal acquisition device 20 and thecomputational unit 31 (microcontroller) are integrated in the samephysical structure. All electrodes are connected to the processing unit26 by electrical wires. In certain embodiments, the electrical wires forthe sensing electrode 23 and reference electrode 24 are shielded wireswith the shielding layers, which share direct connection with thegrounding electrode. The computational unit 31 is a microcontrollerboard, which may receive digital bioelectrical signals from theprocessing unit 26 and execute a set of pre-programed logiccombinations, including controlling the notice unit 11, which is anaudio unit here, to play a set of pre-recorded sounds.

FIG. 5B shows simplified and basic wiring of an interactive system 50including wireless connection with the notice unit 11. As shown in FIG.5B, the bioelectrical signal acquisition device 20 includes a sensingelectrode 23, a reference electrode 24, a grounding electrode 25, aprocessing unit 26, all attached to a headband 21. In certainembodiments, the processing unit 26 includes a processing board as shownin FIG. 5B. In certain embodiments, the bioelectrical signal acquisitiondevice 20 may be a single-channel device, the computational unit 31 maybe a microcontroller, and the notice unit 11 may be one or more wiredaudio earplugs connected to the microcontroller by cable. In certainembodiments, the bioelectrical signal acquisition device 20 and thecomputational unit 31 (microcontroller) are integrated in the samephysical structure. All electrodes are connected to the processing unit26 by electrical wires. In certain embodiments, the electrical wires forthe sensing electrode 23 and reference electrode 24 are shielded wireswith the shielding layers, which share direct connection with thegrounding electrode. In some embodiments, the computational unit 31 mayinclude a wireless transmission component. In certain embodiments, thecomputational unit 31 may receive digital bioelectrical signals from theprocessing unit 26, execute a set of pre-programed logic combinations,and send instructions wirelessly to the notice unit 11, which is anaudio unit here, to play a set of pre-recorded sounds.

Referring to FIGS. 4A-4D and 5A-5B, the interactive system 50 mayinclude a bioelectrical signal acquisition device 20, which in someembodiments may be the bioelectrical signal acquisition device 20 shownin FIGS. 1A-1G, 2 and 3A-3D. the interactive system 50 may include acomputational unit 31 configured to receive the digital bioelectricalsignals from the bioelectrical signal acquisition device 20, process thedigital bioelectrical signals and execute one or more logic sets basedon the digital bioelectrical signals. Here, the phrase “logic set” (or“logic combination) refers to any action/inaction and/or command thatcan be taken or generated by pre-programmed instructions. All theactions/inactions and/or commands are presented, stored transmitted,received, obtained, and/or encoded in electronic and/or magneticsignals.

In some embodiments, the computational unit 31, for example, may includeCOM ports connected to and from a network connected thereto tofacilitate data communications. The computational unit 31 may alsoinclude a processor (e.g., the microprocessor shown in FIGS. 5A-5B), inthe form of one or more processors (e.g., logic circuits), for executingprogram instructions. For example, the processor may include interfacecircuits and processing circuits therein. The interface circuits may beconfigured to receive electronic signals from a bus, wherein theelectronic signals encode structured data and/or instructions for theprocessing circuits to process. The processing circuits may conductlogic calculations, and then determine a conclusion, a result, and/or aninstruction encoded as electronic signals. Then the interface circuitsmay send out the electronic signals from the processing circuits via thebus.

The exemplary computational unit may further include program storage anddata storage of different forms including, for example, a disk, and aread-only memory (ROM), or a random-access memory (RAM), for variousdata files to be processed and/or transmitted by the computational unit.The exemplary computational device may also include program instructionsstored in the ROM, RAM, and/or another type of non-transitory storagemedium to be executed by the processor. The methods and/or processes ofthe present disclosure may be implemented as the program instructions.The computational unit 31 may also include an I/O component, supportinginput/output between the computer and other components. Thecomputational unit 31 may also send and receive programming and data vianetwork communications.

Merely for illustration, only one microprocessor is illustrated in FIGS.5A-5B. Multiple processors are also contemplated; thus, operationsand/or method steps performed by one processor as described in thepresent disclosure may also be jointly or separately performed by themultiple processors. For example, if in the present disclosure theprocessor of the computational unit 31 executes both step A and step B,it should be understood that step A and step B may also be performed bytwo different processors jointly or separately in the computational unit31 (e.g., a first processor executes step A and a second processorexecutes step B or the first and second processors jointly execute stepsA and B).

In some embodiments, the interactive system 50 may be configured tomonitor sleep patterns of the user when the user sleeps or prepares tofall asleep. In certain embodiments, the interactive system 50 may beconfigured to monitor existence and pattern of ocular event-relatedpotentials (o-ERPs) when the user sleeps or prepares to fall asleep. Insome embodiments, the interactive system may be configured to monitoreye blink, eye movement, or eyelid squeezing by processing the digitalbioelectrical signals.

In some embodiments, for the interactive system 50 of the presentdisclosure, the computational unit 31 may be a personal computer, atablet computer, a smart phone, a generic microprocessor, or aspecialized microprocessor. In some embodiments, the computational unit31 may further comprise a low-pass filter, a high-pass filter, or aband-pass filter, or a combination thereof, configured to conduct adigital filtering process on the digital bioelectrical signals providedby the bioelectrical signal acquisition device 20.

As shown in FIGS. 4A-4D and 5A-5B, the interactive system 50 may furtherinclude a notice unit 11, which in some embodiments is an audio unit,which is configured to provide audio signals to the user. In certainembodiments, the audio unit may include an audio earplug, a pair ofaudio-earplugs, a headset, or a speaker. In some embodiments, the audiounit is operationally connected to the computational unit 31 andprovides audio signals under control of the computational unit 31.

In some embodiments, the present disclosure also relates to a method ofmonitoring a physiological or pathological condition of a user, usingthe interactive system 50 as shown in FIGS. 4A-4D and 5A-5B and hereindescribed, the bioelectrical signal acquisition device 20 as shown inFIGS. 1A-1G, 2, and 3A-3D and herein described, or any other interactivesystem and bioelectrical signal acquisition device presented and/ordescribe elsewhere. In some embodiments, the method relates tomonitoring sleep patterns of a user. In some embodiments, the method ofmonitoring sleep patterns of a user includes: providing an interactivesystem; collecting digital bioelectrical signals of the user with thebioelectrical signal acquisition device when the user is asleep or in asleep-related stage; and processing the digital bioelectrical signalswith a computational unit to monitor the sleep patterns of the user.Here, the phrase “sleep-related stage” refers to the user's time andconditions that are close to the time and condition of sleeping. Incertain embodiments, the user is asleep. In certain embodiments, theuser is preparing to fall asleep. In certain embodiments, the user isexperiencing different stages of sleeping, including but not limited tostage 1 sleep, stage 2 sleep, stage 3 sleep, and rapid eye movement(REM) sleep. In certain embodiments, the user is in an awake stage (wakeup time in the morning) immediately after a period of sleep. In certainembodiments, the user is in an awake stage between two close periods ofsleep. In some embodiments, the user goes through a duration thatcombines sleeping and/or some or all of the stages related to sleep.

In some embodiments, the digital bioelectrical signals include EEG, EOG,or EMG signals, or any combination thereof.

In some embodiments, processing the processing the digital bioelectricalsignals includes wave analysis of the time-domain signals and spectrumanalysis of the frequency-domain signals includes wave analysis oftime-domain signals and spectrum analysis of frequency-domain signals.In some embodiments, the sleep patterns include sleep stage, sleep depthand derived results, including total sleep time, onset latency, wakeafter sleep onset, and sleep efficiency.

FIGS. 6A-6C show records of digital bioelectrical signals collected froma user's head by the bioelectrical signal acquisition device accordingto some embodiments of the present disclosure.

FIG. 6A show various types of brainwave data acquired by thebioelectrical signal acquisition device 20 according to some embodimentsof the present disclosure. The digital bioelectrical signals, as well asthe patterns of signals, are shown in FIG. 6A, and these patternsincludes alpha waves (with eyes closed, but user is awake), beta waves(user is engaged in active thinking), delta wave (user is in deepsleep), K-complex pattern (user is in sleep onset stage), spindlepattern (user is in sleep onset stage), lucid dream pattern, andalpha-delta sleep pattern. The patterns shown in FIG. 6A includesignature brainwaves for normal health brain states, such as awake, deepsleep, sleep onset, as well as abnormal states, such as lucid dream andalpha-delta sleep. The data shown in FIG. 6A demonstrate thesensitivity, specificity, reliability, and versatility of thebioelectrical signal acquisition device 20 and the interactive system 50of the present disclosure.

FIG. 6B shows a frequency-domain recording of a user before, during, andafter the sleep onset process by the bioelectrical signal acquisitiondevice 20 according to some embodiments of the present disclosure. Inessence, FIG. 6B illustrates a typical sleep onset process withexcellent data quality acquired by the bioelectrical signal acquisitiondevice 20. With the progress of time:

-   -   In the beginning, in the “awake” stage, alpha band (around 10        Hz) is present, indicating that the user of the bioelectrical        signal acquisition device the user has closed eyes and relax;    -   Following the awake stage, alpha band disappears; the user        starts to fall asleep (N1 stage, or NREM 1, or S1);    -   Following the N1 stage, sigma band (11˜15 Hz) starts to show up;        sigma band represents the spindle wave, which is the signature        sleep onset brainwave for the N2 stage (or NREM 2, or S2);    -   During the N2 stage, low frequency components (0.5˜4 Hz), aka        delta wave, also starts to get stronger, which indicates that        sleep depth is progressing;    -   The bright Delta band during N3 stage indicates the user is in        deep sleep.

The data illustrated in FIG. 6B are highly consistent with classicalstudies of characteristics of a healthy person's brainwave featuresduring a sleep onset process. Such observations prove that thebioelectrical signal acquisition device of the present disclosure iscapable of collecting data with excellent quality. In addition, it showsthat the user easily falls asleep, as what has been observedconsistently when user wears the bioelectrical signal acquisition deviceof the present disclosure. Such observations demonstrate that thebioelectrical signal acquisition device is designed to provide comfortand not to disturb the user when the user tries to fall asleep.

FIG. 6C shows a frequency-domain signal presentation of a user during afull night of sleep by the bioelectrical signal acquisition deviceaccording to some embodiments of the present disclosure. In essence,FIG. 6C shows continuous (non-stop) recording of a full night sleep ofuser, after the user has fallen asleep, with excellent data quality. Thedata demonstrates:

-   -   Five natural sleep cycles, approximately 90 minutes each, are        clearly observable; each cycle starts with light sleep,        progresses to deeper sleep and REM (Rapid Eye Movement) sleep;    -   The lower frequency component (0.5 to 4 Hz), aka delta waves,        indicates the slow-wave sleep; as the night progresses, its        strength decreases at the next sleep cycle—this recorded pattern        is highly consistent with typical sleep patterns for a healthy        human;    -   The higher frequency component (21 to 32 Hz), aka Beta3 waves,        has a strong correlation with REM sleep and dream; as the night        progresses, its time length increases at the next sleep        cycle—this recorded pattern is highly consistent with typical        sleep patterns for a healthy human.

The consistency of the signal patterns here with known patterns is proofthat that the bioelectrical signal acquisition device of the presentdisclosure is capable of collecting data with excellent quality. Inaddition, it shows that the user sleeps through the night without wakingup or being disturbed, as what has been observed consistently when userwears the bioelectrical signal acquisition device of the presentdisclosure. Such observations demonstrate that the bioelectrical signalacquisition device is designed to provide comfort and stability when theuser sleeps or tries to fall asleep. It is observed that even when theuser of the bioelectrical signal acquisition device changes positions(e.g., sleeping on the back, or on the side) or makes adjustments(tossing and turning), the bioelectrical signal acquisition device canmaintain effective electrode contacts and thus acquire high qualitydata.

The present disclosure also relates to a method of human-computerinteraction. In some embodiments, the method of human-computerinteraction is carried out with the assistance of a human-computerinteractive system. In some embodiments, the human-computer interactivesystem includes the interactive system 50 as shown in FIGS. 4A-4D and5A-5B and herein described. In some embodiments, the human-computerinteractive system includes a bioelectrical signal acquisition device.In some embodiments, the human-computer interactive system includes thebioelectrical signal acquisition device 20 as shown in FIGS. 1A-1G, 2,and 3A-3D and herein described. It should be noted, however, that themethod of human-computer interaction can be carried out with any otherinteractive system and/or other bioelectrical signal acquisition devicepresented and/or describe elsewhere, as long as the system/device iscapable of providing certain key functions of the interactive system 50and the bioelectrical signal acquisition device 20 stated above.

Referring to FIG. 7, in some embodiments, the method of human-computerinteraction includes: providing a signal sequence to the user; recordingdigital bioelectrical signals from the user's head using a bioelectricalsignal acquisition device; processing the digital bioelectrical signalsand identifying the existence and the pattern of ocular event-relatedpotentials (o-ERPs); and taking one or more actions based on theexistence and the patterns of the o-ERPs. In some embodiments, thedigital bioelectrical signals are processed by an interactive system. Insome embodiments, the digital bioelectrical signals are provided by abioelectrical signal acquisition device. In some embodiments, thedigital bioelectrical signals are processed by the computational unit 31of the interactive system 50. In some embodiments, the digitalbioelectrical signals are provided by the bioelectrical signalacquisition device 20.

Referring to 710 of FIG. 7, in some embodiments, the method ofhuman-computer interaction includes a step of providing a signalsequence to the user. The signal sequence can include any signals thatmay catch the attention of the user or provide notification to the user.The signals can be visual, tactile, verbal, acoustic, olfactory, or anycombination thereof. For example, in certain embodiments, the signalsequence includes touching the user, sending vibration to the user,playing sound to the user, or applying light to the user, or anycombinations thereof. The signal sequence may include signals withspecific properties, patterns, or meanings. The following descriptionwould use audio signals according to some exemplary embodiments of thepresent disclosure. However, it should be noted that sound is only usedas examples; other signals, such as but not limited to vibration, can beapplied according to the present disclosure, especially by mimicking thesignal patterns of the embodiments below based on sound.

In some embodiments, the signal sequence is related to upcominginteractions between the user and the interactive system. In someembodiments, the signal sequence may include more detailed information.For example, the signal sequence may include: a description, a question,or an instruction, or any combination thereof, all relating to upcominginteractions between the user and the interactive system. As used forthe signal sequence, “description” includes an explanation of theupcoming interactions, and the explanation is about context, or past,current and expected logic states of the upcoming interactions;“question” includes a presentation of one or more question (e.g.,multiple choice questions) with or without possible answers (e.g., listof choices) designed for the upcoming interactions; “instruction”includes information on how to provide a response, such as but notlimited to making a selection among the choices presented in the“question”. In some embodiments, the description, question, and/orinstruction may also serve as a notice to the user that an interactionis about to begin.

In some embodiments, the description, question, and/or instruction maytake the form one or more simple and short signals that can be termed asa “notification”. In certain embodiments, the notification can indicateto the user that an interaction is about to begin. In some embodiments,the notification may be carried out by one or more simple and shortsignals. The notification may be based on pre-designed interactions andpre-determined instructions to the user so that the user may know whatsuch a notification entails. For example, a notification can serve as adescription, providing all the contents of the description with one ormore simple and short signals because the user has been informedbeforehand. As another example, a notification can serve as a questionor an instruction, providing all the contents of the question or theinstruction with one or more simple and short signals because the userhas been informed beforehand. In some cases, the signal sequence mayonly include such a notification.

In some embodiments, the signals sequence is provided by the interactivesystem 50 as described above. For example, the notice unit 11 can beused to send out the signal sequence. In some embodiments, the noticeunit 11 is an audio unit that can send sound signals. In someembodiments, the notice unit 11 can provide tactile signals (e.g.,vibration) to the user. For example, the notice unit 11 can be attachedto the headband 21 and configured to send vibrating signals to the userwhen the user wears the bioelectrical signal acquisition device 20.

In some embodiments, the signal sequence may include a signal template(e.g., an audio template) that include repeated or rhythmic signals. Forexample, the description or instruction may include a signal template.The user can follow pre-determined or real-time explanations and utilizethe audio template as basis for input (e.g., by blinking, squeezingeyelid, making eye movement, etc.), thus forming patterns to make achoice or convey certain meanings. In some embodiments, such patternsmay take the form of a binary sequence. For example, in certainembodiments, the patterns can be sequences defined in Morse code, sinceit is a well-known binary sequence representing English alphabets.Certain examples of audio template and corresponding recordings areprovided below.

In certain scenarios, especially when there is a high noise level in thedata acquired by the bioelectrical signal acquisition device 20, it maybe easier (i.e. with higher identification accuracy) to detect inputsignals (e.g., o-ERPs) with patterns (e.g. following instructions andbased on a signal template) than a single input signal.

In some embodiments, the method of human-computer interaction mayinclude a presentation of one or more questions/prompts and list ofchoices for the upcoming interactions. In some embodiments, the methodof human-computer interaction may include a presentation ofmultiple-choice questions/prompts and list of choices for the upcominginteractions. Such questions/prompts and choices can be presented invarious ways, examples of which are shown below.

In some embodiments, the signal sequence may include one or more stepsof conditional choices. In some embodiments, one step of the conditionalchoices may include a binary-choice conditional branch, which istriggered by a presence of a detected o-ERP during a pre-determined timeperiod. In some embodiments, one step of the conditional choices mayinclude a multiple-choice conditional branch, which is triggered by twoor more detected o-ERPs during a pre-determined time period.

In some embodiments, the method of human-computer interaction mayinclude eliciting a response from the user. In some embodiments, themethod of human-computer interaction may include presenting (e.g. sendaudio instructions) information to the user on how to provide aresponse. In some embodiments, the method of human-computer interactionmay include presenting (e.g. send audio instructions) information to theuser on how to make a selection among the choices presented to the user.

In some embodiments, providing a response includes eye blink, eyemovement, or eyelid squeezing, or any combination thereof, by the user.

In some embodiments, the method of human-computer interaction mayinclude providing a plurality of sounds to the user. In someembodiments, the plurality of sounds may include one or more rhythmicaudio templates, which may be any kind of audio signals following apattern and recycling style. In certain embodiments, the rhythmic audiotemplate may include sounds of beats, metronome, ding, chirp, ticking,amplitude-modulated tones or noises, frequency-modulated tones ornoises, binaural beats, music pattern, or any form of rhythmic sound. Insome embodiments, the user can use the rhythmic audio templates to sendresponses, such as but not limited to binary signal responses. In someembodiments, for the method of human-computer interaction, the rhythmicaudio templates may have a rhythmic frequency between 0.5 Hz and 4 Hz,preferably between 1 Hz and 2 Hz.

Referring to 720 of the process shown in FIG. 7, the method ofhuman-computer interaction may further include recording digitalbioelectrical signals from the user's head using a bioelectrical signalacquisition device. In some embodiments, the preferable device the isthe bioelectrical signal acquisition device 20 shown in FIGS. 1A-1G, 2,and 3A-3D.

Referring to 730 of the process shown in FIG. 7, the method ofhuman-computer interaction may further include processing the digitalbioelectrical signals and identifying the existence and the pattern ofocular event-related potentials (o-ERPs). The processing of the digitalbioelectrical signals and the identification of the o-ERPs may becarried out by any device having such capabilities. In some embodiments,the digital bioelectrical signals may be processed by a computingdevice. In some embodiments, the digital bioelectrical signals may beprocessed by a computational unit 31 as part of the interactive system50.

In some embodiments, the method of human-computer inaction may be basedon a method of detecting o-ERPs, which comprises operations 720 and 730of the process shown in FIG. 7.

In some embodiments, the o-ERPs result from eye blinking, eye movement,or eyelid squeezing, or any combination thereof, by the user. In someembodiments, the eye movement and eyelid squeezing are performed by theuser with the user's eyes closed.

One of the key difficulties and a long-felt but unsolved need to carryout an effective interaction with a user when the user is trying tosleep, or when the user is in the sleep-onset stage, without disturbingthe user to make the user fully awake. The difficulty lies, in largepart, in finding a balance between “effectiveness” and “no disturbance”.However, sometimes such interactions may be important and/or beneficialand need to be carried out. Some embodiments of the methods of thecurrent disclosure find such a balance so that, at least in some cases,an interaction can be effectively carried out without seriousdisturbance to the user. In some cases, such balance is achieved bymonitoring the o-ERPs, because the actions that trigger the o-ERPs maybe minimum. When the user is prepared to fall asleep, the digitalbioelectrical signals collected from the user's head are mainly lowamplitude EEG signals. With such a background, the o-ERPs can bedetected based on a change of signal amplitude, as discussed and shownbelow. Eye blinks, especially limited (small) blinks, can trigger o-ERPsthat can be detected so that further actions can be taken. Eyemovements, especially movements when the eyes are closed, can triggero-ERPs that can be detected so that further actions can be taken. Eyelidsqueezing, conducted when the eyes are closed, can trigger o-ERPs thatcan be detected so that further actions can be taken. While thebioelectrical signal acquisition device 20 and interactive system 50herein described provide ideal apparatus to fulfill this goal, otherdevices may also be used if such capabilities are present.

Referring to the method of human-computer inaction and operations 720and 730 in FIG. 7, the digital bioelectrical signals may have a samplerate ranging from 100 samples per second to 10000 samples per second,preferably from 250 to 1000 samples per second.

Referring to the method of human-computer inaction and operations 720and 730 in FIG. 7, processing the digital bioelectrical signals andidentifying the existence and the pattern of o-ERPs may include adigital filtering process, using a low-pass filter, a high-pass filter,or a band-pass filter, or a combination thereof. In certain embodiments,a filter type is used in the digital filtering process, and the filtertype is Butterworth, Chebyshev 1, Chebyshev 2, or Elliptic. In certainembodiments, the low-pass filter has a cut-off frequency that is between4 Hz and 48 Hz, preferable between 35 and 45 Hz; and the low-pass filterhas a number of order that is between 1 and 14, preferable between 8 and12. In certain embodiments, the low-pass filter is 10th orderButterworth with a cut-off at 40 Hz. the low-pass filter has a lowercut-off frequency between 0.25 Hz and 2 Hz, preferable between 0.5 Hzand 1 Hz. the band-pass filter has an upper frequency limit between 4 Hzand 48 Hz, preferable between 35 Hz and 45 Hz; and the band-pass filterhas a lower frequency limit between 0.25 Hz and 2 Hz, preferable between0.5 Hz and 1 Hz.

Referring to the method of human-computer interaction and operations 720and 730 in FIG. 7, processing the digital bioelectrical signals andidentifying the existence and the pattern of o-ERPs may includeanalyzing a time-domain presentation, also known as a wave chart,wherein an x-axis represents time, and a y-axis represents the amplitudeof an electrical voltage.

Referring to the method of human-computer inaction and operations 720and 730 in FIG. 7, processing the digital bioelectrical signals mayinclude analyzing a frequency-domain presentation, also known as aspectrogram, wherein an x-axis represents time, and a y-axis representsfrequencies. In certain embodiments, identifying the o-ERPs includessetting a proper threshold range (or setting proper thresholds) andidentifying patterns in a time-domain presentation that are outside thethreshold range. In certain embodiments, the threshold range is from 5to 300 uV. In certain embodiments, the threshold range is 20 to 100 uV.In some embodiments, identifying the o-ERPs includes template matchingwith a predefined o-EPR template in the time-domain presentation, with amatching score threshold range from 20 to 90, preferably between 60 to80. In certain embodiments, identifying the o-ERPs includes detectinglong gaps between zero-crosses in the time-domain presentation, whereinthe gaps are outside a threshold range. In some embodiments, thethreshold range is from 0.01 second to 0.2 second. In certainembodiments, the threshold range is between 0.05 second and 0.15 second.

Referring to the method of human-computer inaction and operations 720and 730 in FIG. 7, processing the digital bioelectrical signals andidentifying the existence and the pattern of o-ERPs may include applyinga fast Fourier transform (FFT) to data derived from the digitalbioelectrical signals to generate a frequency-domain presentation.

In some embodiments, identifying the o-ERPs is based on a patternrecognition of the o-ERPs based on identifying patterns outside a firstthreshold range in the time-domain presentation, or identifying patternsoutside a second threshold range in the frequency-domain presentation.In some embodiments, identifying the o-ERPs is based on a patternrecognition of the o-ERPs based on identifying patterns outside a firstthreshold range in the time-domain presentation, and identifyingcorresponding patterns outside a second threshold range in thefrequency-domain presentation.

In some embodiments, pattern recognition of the o-ERPs may include atemplate matching algorithm, utilizing a template selected from sinewaves, triangle wave, rectangle waves, and other periodic waves with thesame frequency as the audio's rhythm, enveloped by the binary sequencefrom the pattern.

Referring to the method of human-computer inaction and operations 720and 730 in FIG. 7, processing the digital bioelectrical signals andidentifying the existence and the pattern of o-ERPs may further includeapplying a window function to the data derived from the digitalbioelectrical signals before the FFT. In certain embodiments, the windowfunction includes rectangular window, triangular window, Parzen window,Welch window, sine window, cosine-sum window, Hann window, Hammingwindow, Blackman window, or Nattall window, or other common windowfunctions in the field of digital signal processing; preferably a Hannwindow. In certain embodiments, the window function has a window sizeranging between 100 to 100000 samples, preferably collected in Nseconds, where N is a positive integer.

Referring to the method of human-computer inaction and operations 720and 730 in FIG. 7, processing the digital bioelectrical signals andidentifying the existence and the pattern of o-ERPs may further includeapplying a zero-padding step before applying the FFT transformation toraise a number of samples by an N^(th) order of 2, where N is a positiveinteger.

Referring to the method of human-computer inaction and operations 720and 730 in FIG. 7, processing the digital bioelectrical signals andidentifying the existence and the pattern of o-ERPs may further includeapplying a step of down sampling before the FFT, reducing the samplerate between 100 and 1000, preferably between 120 and 300.

Referring to the method of human-computer inaction and operations 720and 730 in FIG. 7, processing the digital bioelectrical signals andidentifying the existence and the pattern of o-ERPs may includeidentifying the o-ERPs is based on a pattern recognition of the o-ERPsbased on one or more thresholds in the time-domain presentation, or oneor more thresholds in frequency-domain presentation. In someembodiments, the pattern recognition of the o-ERPs includes a templatematching algorithm, utilizing a template selected from sine waves,triangle wave, rectangle waves, and other periodic waves with the samefrequency as the audio's rhythm, enveloped by the binary sequence fromthe pattern.

Referring to the method of human-computer inaction and operation 740 inFIG. 7, one or more actions can be taken based on the existence and thepatterns of the o-ERPs. The actions can be any actions that can be takena person or a device. In certain embodiments, the actions are notrelated directly to the user. In certain embodiments, the actions aredirectly related to the user. For example, if the envisioned o-ERPs aredetected, the interactive system 50 may send another signal sequence tothe user and start any iteration of the human-computer interactiveprocess. As another example, if the envisioned o-ERPs are detected, acaregiver (or doctor/nurse) may give the user certain medicine ortreatment. In some embodiments, the actions are taken to modulate thephysiological, mental, or pathological state of the user. In certainembodiments, the actions may be taken to assist the user's efforts tofall asleep. For example, the interactive system 50 may start playing asoothing music or reading a book to assist the user to fall asleep.

In some embodiments, the one or more actions may include sending anothersignal sequence to the user. In some embodiments, the one or moreactions may include one or more steps of conditional choices. In someembodiments, one step of the conditional choices may include abinary-choice conditional branch, which is triggered by a presence of adetected o-ERP during a pre-determined time period. In some embodiments,one step of the conditional choices may include a multiple-choiceconditional branch, which is triggered by two or more detected o-ERPsduring a pre-determined time period.

In some embodiments, the one or more actions are taken by thecomputational unit 31, the audio unit 11, or the bioelectrical signalacquisition device 20.

In some embodiments, the one or more action may include: playingadditional sounds with increased or decreased volume, playing apre-recorded audio file, repeating a previous question, triggering afunction menu, starting an insomnia treatment session, startingrecording sound, sending a message, or sharing current sleep status insocial media, or any combination thereof.

The method of human-computer interaction may further include detectingan abnormal signal before providing the signal sequence to the user. Theabnormal signal may be detected by the interactive system 50 or by otherdevices or a person (e.g., a caregiver). The abnormal signal may be anysignal that shows anything that is out of order. For example, theabnormal signal may show that the user is not able to proceed to thesleep onset stage after lying for longer than a threshold period oftime.

Certain examples are herein provided based on audio (sound) signals.However, as indicated above, in some cases, the sound signals can bereplaced by other signals, such as tactile signals (e.g., vibrations)and convey essentially the same meanings and achieving similar goals. Incertain embodiments, the sound signals can be partially replaced, sothat other signals (e.g., vibrations) can be combined with the soundsignals and achieving similar goals. In some embodiments, providing thesignal sequence to the user includes playing a plurality of sounds tothe user with an audio unit.

FIGS. 8A-8C show an exemplary process of human-computer interaction andthe recorded signals according to some embodiments of the presentdisclosure. FIG. 8A is a flowchart of the process according to someembodiments of the present disclosure. In some embodiments, the audiounit plays an audio instruction, teaching the user how to make a yes/noselection. Then bioelectrical signal acquisition device 20 collectsdigital bioelectrical signals from the user and transmits the digitalbioelectrical signals to the computational unit 31, where the signalsare processed, and o-ERPs are identified and analyzed. Based on thepresence of the o-ERP, the choice between yes and no can be made.

FIG. 8B is a time-domain signal presentation, or wave chart, showingsome exemplary results of a test that was carried out in the processshown in FIG. 8A. The x axis represents time; they axis represents theamplitude of the electrical voltage difference between the sensingelectrode and the reference electrode. As shown in FIG. 8B, the usersqueezed his eyelids as instructed and elicited an o-ERP, which wasdetected by the bioelectrical signal acquisition device 20 and processedby the computational unit 31. As shown in FIG. 8B, when there is noo-ERP (highlighted by the oval on the left), the amplitude variationsare low; when there is an o-ERP (highlighted by the oval on the right),the amplitude variations are high. The presence of the o-ERP wasdetermined by setting proper thresholds in the wave chart for amplitude.

FIG. 8C is a frequency-domain presentation, or a spectrogram. The x axisrepresents time; they axis represents frequency. The color of the pixelsrepresents the calculated values of a fast-Fourier transform (FFT) ofthe time-domain signals. When there is no o-ERP (highlighted by the ovalon the left), the pixels are shown mostly in blue and green; when thereis an o-ERP (highlighted by the oval on the right), the pixels are shownmostly in red, orange, and yellow. Another way to describe thefrequency-domain presentation is to interpret a warmer color (e.g.,yellow, orange, or red) as having higher intensity and a colder color(e.g., green and blue) as having a lower intensity. In fact, in somespectrograms, the intensity is directly represented by brightness of thepixels. Therefore, the presence/pattern of the o-ERPs can be detected bysetting proper thresholds in the color (or intensity) in thespectrogram, especially in the low frequency (e.g., less than 5 Hz)range.

FIG. 9A-9E show an exemplary process of human-computer interaction andthe recorded signals according to some embodiments of the presentdisclosure. FIG. 9A is a flowchart of the process according to someembodiments of the present disclosure. In some embodiments, the audiounit plays an audio instruction, teaching the user how to make a yes/noselection, followed by a series of rhythmic beats as an audio template.Then bioelectrical signal acquisition device 20 collects digitalbioelectrical signals from the user and transmits the digitalbioelectrical signals to the computational unit 31, where the signalsare processed, and o-ERPs are identified and analyzed. Based on thepresence and pattern of the o-ERP, the choice between yes and no can bemade.

FIG. 9B shows an audio template at a pace of twice per second. Thisaudio template was used in a test carried out according to FIG. 9A. Theaudio signals were a sequence of metronome ticks at a pace of twice persecond.

FIG. 9C is a time-domain signal presentation, or wave chart, showingsome exemplary results of a test that was carried out in the processshown in FIG. 9A, with a sequence of synchronized o-ERPs correspondingto the audio template shown in FIG. 9B. As shown in FIG. 9C, the userthat squeezed his eyelids as instructed and provided the sequence ofsynchronized o-ERPs, which were detected by the bioelectrical signalacquisition device 20 and processed by the computational unit 31. Thepresence of the o-ERP was determined by setting proper thresholds forthe amplitude. Based on the consistency of the o-ERP with the audiotemplate, the choice between yes and no was made. FIG. 9D shows afrequency histogram with a peak at 2 Hz, consistent with the audiotemplate shown in FIG. 9B.

FIG. 9E is a frequency-domain presentation, or a spectrogram, showingsome exemplary results of the test that was carried out according to theprocess shown in FIG. 9A, with a sequence of synchronized o-ERPscorresponding to the audio template shown in FIG. 9B. The presence andpattern of the o-ERPs were detected by the bioelectrical signalacquisition device 20 and processed by the computational unit 31. Thesequence of o-ERPs was detected with high-intensity spots, with a 2 Hzfrequency.

In some embodiments, the signal sequence may include a signal template(e.g., an audio template) that include repeated signals. The user canfollow an instruction (pre-determined or real-time) and utilize theaudio template as basis for input (e.g., by squeezing eyelid, making eyemovement, etc.), forming patterns to make a choice or convey certainmeanings. Such patterns may take the form of a binary sequence. Forexample, in certain embodiments, the patterns may be “***---***”,“**-**-**”, “*--**”, “**----*”, etc. (“*” and “-” represent presence andabsence of a blink, respectively).

FIGS. 10A-10B show an exemplary audio signal template (FIG. 10A), adigital bioelectrical signal recording (FIG. 10B) in response to theaudio signal template, and a corresponding result chart (FIG. 10C) ofthe digital bioelectrical signal recording, according to someembodiments of the present disclosure. When a user squeezed eyelidsaccording to an instructed pattern, “***---***”, at the rhythm given bythe audio template (FIG. 10A), a binary sequence of synchronized o-ERPswas detected in the time-domain presentation, or the wave chart (FIG.10B). The “***---***” pattern was recognized (FIG. 10C) in thetime-domain presentation by setting proper thresholds for signalamplitude, or by using a template matching algorithm using apattern-enveloped audio template (FIG. 10C). In some embodiments, thepositive result may trigger further corresponding actions by theinteractive system 50.

In some embodiments, the patterns can be sequences defined in Morsecode, since it is a well-known binary sequence representing Englishalphabets. For example, the “***---***” pattern in FIG. 10C may beinterpreted as “SOS” according to Morse code.

In certain scenario, when there is a high noise level in the dataacquired by the bioelectrical signal acquisition device 20, it may beeasier (i.e. with higher identification accuracy) to detect positiveinput (e.g., o-ERPs) with patterns (e.g. as the embodiment shown inFIGS. 10A-10C) than single input (e.g., as the embodiment shown in FIGS.8A-8C).

FIGS. 11A-11D show various exemplary audio signal templates according tosome embodiments of the present disclosure. In some embodiments, theaudio template may be a serious of beats, metronome, ding, chirp,ticking, amplitude-modulated tones or noises, frequency-modulated tonesor noises, binaural beats, music pattern, or any form of rhythmic sound,binaural beats, music or other rhythmic sound tracks. For example, FIG.11A shows clicks, FIG. 11B shows chirps, FIG. 11C shows amplitudemodulated tones, and FIG. 11D shows binaural beats.

FIGS. 12A-12C shows an exemplary process of human-computer interactionand the recorded digital bioelectrical signals collected from a user'shead by the bioelectrical signal acquisition device according to someembodiments of the present disclosure.

FIG. 12A is a flowchart of the process in which the user is presentedwith multiple choices. In some embodiments, the audio unit plays anaudio instruction, teaching the user how to make a multiple-choiceselection, by squeezing eyelids for the number of times that the userintends to choose. Then bioelectrical signal acquisition device 20collects digital bioelectrical signals from the user and transmits thedigital bioelectrical signals to the computational unit 31, where thesignals are processed, and o-ERPs are identified and analyzed. Based onthe number of the o-ERPs, the choice is made.

FIG. 12B is a time-domain signal presentation, or wave chart, showingsome exemplary results of a test that was carried out in the processshown in FIG. 12A. As shown in FIG. 12B, the user that squeezed hiseyelids as instructed and the o-ERPs were detected by the bioelectricalsignal acquisition device 20 and processed by the computational unit 31.The presence and the number of the o-ERPs were determined by settingproper thresholds for the amplitude. When there are 1, 2 and 3 o-ERPs(from left to right), there are 1, 2 and 3 high amplitude main peaks.Therefore, the identification of the o-ERP can be determined by settingproper thresholds for the amplitude and counting the number of mainpeaks.

In some embodiments, the number of o-ERPs can be identified by othermethods, such as detecting long gaps between zero-crosses in time domaindata, or template matching with a predefined o-EPR template.

FIG. 12C provides an alternative process similar to the process shown inFIG. 12A. In some embodiments, the number of choices may be more than 3.With the same logic principle as shown in FIG. 12A, the method can applyto any number of choices, simply by adding the more choices in theinstruction, as well as the o-ERP identification process, as shown inFIG. 12C, in which the user is instructed to squeeze eyelids for 2, 4,or 6 times to choose options 1, 2, and 3, respectively. In certainembodiments, it is more accurate to differentiate between 2, 4, and 6o-ERPs than to differentiate between 1, 2, and 3 o-ERP, especially whennoise is high.

FIGS. 13A-13B show an exemplary process of human-computer interactionand the recorded digital bioelectrical signals collected from a user'shead by the bioelectrical signal acquisition device according to someembodiments of the present disclosure; FIG. 13A is a flowchart of theprocess according to some embodiments of the present disclosure; FIG.13B is time-domain signal presentation, or wave chart.

FIG. 13A is a flowchart of the process in which the user is presentedwith multiple choices. In some embodiments, the audio unit plays anaudio instruction, teaching the user how to make a multiple-choiceselection, by squeezing eyelids after the desired option is presentedand before the next option is presented. Then bioelectrical signalacquisition device 20 collects digital bioelectrical signals from theuser and transmits the digital bioelectrical signals to thecomputational unit 31, where the signals are processed, and o-ERPs areidentified and analyzed. Based on the presence of o-ERP detected withinthe defined time frame, the choice is made.

FIG. 13B is a time-domain signal presentation, or wave chart, showingsome exemplary results of a test that was carried out in the processshown in FIG. 13A, As shown in FIG. 13B, the user that squeezed hiseyelids as instructed and the o-ERP was detected by the bioelectricalsignal acquisition device 20 and processed by the computational unit 31.The presence of the o-ERPs was determined by setting proper thresholdsfor the amplitude. An o-ERP was detected in the third time frame, butnot in the first two time frames.

FIG. 14 is a flowchart showing an exemplary process of human-computerinteraction according to some embodiments of the present disclosure. Theembodiment shown in FIG. 14 demonstrates that the menu may be on anyquestion and the logic cycle can extend indefinitely.

Comparing to the embodiments shown in the FIGS. 12A-12C, the cascademenu selection approach shown in FIGS. 13-14 releases the user from theburden of memorizing the number of choice and accurately squeeze theintended number of times. In certain scenarios, it is a preferableapproach when the list of options is long.

FIG. 15 is a flowchart showing an exemplary process of human-computerinteraction according to some embodiments of the present disclosure. Theembodiment shown in FIG. 15 demonstrates an example of more than onemethod being combined, to realized high selection accuracy onmultiple-choice questions.

FIG. 16 is a flowchart showing an exemplary process of human-computerinteraction according to some embodiments of the present disclosure. Theembodiment shown in FIG. 16 demonstrates an example of fail-safe logicto allow user to confirm or reject the choice just made.

FIG. 17 is a flowchart showing an exemplary process of human-computerinteraction according to some embodiments of the present disclosure. Theembodiment shown in FIG. 17 demonstrates an example of a mechanism toinitiate the human-computer interaction from an idle state, by bring themenu up to the user when there is no active interaction.

Typically, when a user is asleep or ready to sleep, the signalscollected by the bioelectrical signal acquisition device 20 are mainlylow amplitude EEG signals. When a significant aberrant signal isdetected, it is usually due to EOG or EMG artifacts commonly associatedwith user's eye movements, facial movements or head movements, eithervoluntarily or involuntarily. When such events take place, the devicemay present a weak rhythmic audio template. If the user intends toactivate the menu, he or she can certain actions (e.g., squeeze eyelids)according to the audio template, and further instructions and menu maybe presented through the audio playing unit. If the user doesn't want toactivate the menu, or the artifact was simply from sleep postureadjustment, REM or some other incident, user will not carry out thespecific eye movement set by the audio template, and the interactivesystem 50 will return to regular recording state and continue to monitorthe signals.

Having thus described the basic concepts, it may be rather apparent tothose skilled in the art after reading this detailed disclosure that theforegoing detailed disclosure may be intended to be presented by way ofexample only and may be not limiting. Various alterations, improvements,and modifications may occur and are intended to those skilled in theart, though not expressly stated herein. These alterations,improvements, and modifications are intended to be suggested by thisdisclosure, and are within the spirit and scope of the exemplaryembodiments of this disclosure.

Moreover, certain terminology has been used to describe embodiments ofthe present disclosure. For example, the terms “one embodiment,” “anembodiment,” and/or “some embodiments” mean that a particular feature,structure or characteristic described in connection with the embodimentmay be included in at least one embodiment of the present disclosure.Therefore, it may be emphasized and should be appreciated that two ormore references to “an embodiment” or “one embodiment” or “analternative embodiment” in various portions of this specification arenot necessarily all referring to the same embodiment. Furthermore, theparticular features, structures or characteristics may be combined assuitable in one or more embodiments of the present disclosure.

Further, it will be appreciated by one skilled in the art, aspects ofthe present disclosure may be illustrated and described herein in any ofa number of patentable classes or context including any new and usefulprocess, machine, manufacture, or composition of matter, or any new anduseful improvement thereof. Accordingly, aspects of the presentdisclosure may be implemented entirely hardware, entirely software(including firmware, resident software, micro-code, etc.) or combiningsoftware and hardware implementation that may all generally be referredto herein as a “unit,” “module,” or “system.” Furthermore, aspects ofthe present disclosure may take the form of a computer program productembodied in one or more computer readable media having computer readableprogram code embodied thereon.

A computer readable signal medium may include a propagated data signalwith computer readable program code embodied therein, for example, inbaseband or as part of a carrier wave. Such a propagated signal may takeany of a variety of forms, including electro-magnetic, optical, or thelike, or any suitable combination thereof. A computer readable signalmedium may be any computer readable medium that may be not a computerreadable storage medium and that may communicate, propagate, ortransport a program for use by or in connection with an instructionexecution system, apparatus, or device. Program code embodied on acomputer readable signal medium may be transmitted using any appropriatemedium, including wireless, wireline, optical fiber cable, RF, or thelike, or any suitable combination of the foregoing.

Computer program code for carrying out operations for aspects of thepresent disclosure may be written in any combination of one or moreprogramming languages, including an object to be recognized orientedprogramming language such as Java, Scala, Smalltalk, Eiffel, JADE,Emerald, C++, C#, VB. NET, Python or the like, conventional proceduralprogramming languages, such as the “C” programming language, VisualBasic, Fortran 2103, Perl, COBOL 2102, PHP, ABAP, dynamic programminglanguages such as Python, Ruby, and Groovy, or other programminglanguages. The program code may execute entirely on the user's computer,partly on the user's computer, as a stand-alone software package, partlyon the user's computer and partly on a remote computer or entirely onthe remote computer or server. In the latter scenario, the remotecomputer may be connected to the user's computer through any type ofnetwork, including a local part network (LAN) or a wide part network(WAN), or the connection may be made to an external computer (forexample, through the Internet using an Internet Service Provider) or ina cloud computing environment or offered as a service such as a Softwareas a Service (SaaS).

Furthermore, the recited order of processing elements or sequences, orthe use of numbers, letters, or other designations therefore, may be notintended to limit the claimed processes and methods to any order exceptas may be specified in the claims. Although the above disclosurediscusses through various examples what may be currently considered tobe a variety of useful embodiments of the disclosure, it may be to beunderstood that such detail may be solely for that purposes, and thatthe appended claims are not limited to the disclosed embodiments, but,on the contrary, are intended to cover modifications and equivalentarrangements that are within the spirit and scope of the disclosedembodiments. For example, although the implementation of variouscomponents described above may be embodied in a hardware device, it mayalso be implemented as a software only solution, for example, aninstallation on an existing server or mobile device.

Similarly, it should be appreciated that in the foregoing description ofembodiments of the present disclosure, various features are sometimesgrouped together in a single embodiment, figure, or description thereoffor the purposes of streamlining the disclosure aiding in theunderstanding of one or more of the various inventive embodiments. Thismethod of disclosure, however, may be not to be interpreted asreflecting an intention that the claimed subject matter requires morefeatures than are expressly recited in each claim. Rather, inventiveembodiments lie in less than all features of a single foregoingdisclosed embodiment.

In some embodiments, the numbers expressing quantities or propertiesused to describe and claim certain embodiments of the application are tobe understood as being modified in some instances by the term “about,”“approximate,” or “substantially.” For example, “about,” “approximate,”or “substantially” may indicate ±20% variation of the value itdescribes, unless otherwise stated. Accordingly, in some embodiments,the numerical parameters set forth in the written description andattached claims are approximations that may vary depending upon thedesired properties sought to be obtained by a particular embodiment. Insome embodiments, the numerical parameters should be construed in lightof the number of reported significant digits and by applying ordinaryrounding techniques. Notwithstanding that the numerical ranges andparameters setting forth the broad scope of some embodiments of theapplication are approximations, the numerical values set forth in thespecific examples are reported as precisely as practicable.

Each of the patents, patent applications, publications of patentapplications, and other material, such as articles, books,specifications, publications, documents, things, and/or the like,referenced herein may be hereby incorporated herein by this reference inits entirety for all purposes, excepting any prosecution file historyassociated with same, any of same that may be inconsistent with or inconflict with the present document, or any of same that may have alimiting affect as to the broadest scope of the claims now or laterassociated with the present document. By way of example, should there beany inconsistency or conflict between the description, definition,and/or the use of a term associated with any of the incorporatedmaterial and that associated with the present document, the description,definition, and/or the use of the term in the present document shallprevail.

In closing, it is to be understood that the embodiments of theapplication disclosed herein are illustrative of the principles of theembodiments of the application. Other modifications that may be employedmay be within the scope of the application. Thus, by way of example, butnot of limitation, alternative configurations of the embodiments of theapplication may be utilized in accordance with the teachings herein.Accordingly, embodiments of the present application are not limited tothat precisely as shown and describe.

Statements of Invention

Device

Section 1.1. A bioelectrical signal acquisition device, comprising:

a headband configured to be wearable around a user's head,

a sensing electrode attached to the headband;

a reference electrode attached to the headband;

-   -   wherein the sensing electrode and the one or more reference        electrodes are configured to provide sensing signals from the        user's head, and the reference electrode is configured to cover        at least part of a bottom side of a segment of the headband, and

a processing unit configured to generate digital bioelectrical signalsbased on the sensing signals.

Section 1.2. The bioelectrical signal acquisition device of Section 1.1,further comprising a grounding electrode attached to the headband andconfigured to provide electronic grounding, wherein the groundingelectrode is positioned on the headband to contact the user's skin, whenthe user wears the bioelectrical signal acquisition device on the user'shead.

Section 1.3. The bioelectrical signal acquisition device of Section 1.1,wherein the sensing electrode is positioned on the headband to contactthe skin on the forehead or around the eyes of the user, and thereference electrode is positioned on the headband to contact the skinon, over, above, behind, or around an ear of the user, when the userwears the bioelectrical signal acquisition device on the user's head.

Section 1.4. The bioelectrical signal acquisition device of Section 1.1,wherein the reference electrode is configured to cover a lower portionof the bottom side of the segment of the headband.

Section 1.5. The bioelectrical signal acquisition device of Section 1.1,wherein the reference electrode is configured to cover a lower portionof the bottom side and a lower edge of the segment of the headband.

Section 1.6. The bioelectrical signal acquisition device of Section 1.1,wherein the reference electrode is configured to cover the entire bottomside and a lower edge of the segment of the headband.

Section 1.7. The bioelectrical signal acquisition device of any ofSections 1.1-1.6, wherein the processing unit comprises an electricalsignal amplification circuit configured to amplify the sensing signals;and an analog-to-digital converting circuit configured to convert analogsignals to digital signals.

Section 1.8. The bioelectrical signal acquisition device of Sections1.1-1.7, future comprising signal wires connecting the sensing electrodeand the reference electrodes to an input port of the signalamplification circuit.

Section 1.9. The bioelectrical signal acquisition device of any ofSections 1.2-1.8, wherein at least a portion of the wires are shieldedwires comprising a shielding layer, and the shielding layer is connectedto the grounding electrode.

Section 1.10. The bioelectrical signal acquisition device of any ofSections 1.1-1.9, further comprising a transmission element configuredto transmit the digital bioelectrical signals to a computational unitvia wire or with wireless transmission.

Section 1.11. The bioelectrical signal acquisition device of Section1.10, wherein the wireless transmission is through BLUETOOTH or WIFI.

Section 1.12. The bioelectrical signal acquisition device of any ofSections 1.1-1.11, which is a single-channel bioelectrical signalrecorder.

Section 1.13. The bioelectrical signal acquisition device of any ofSections 1.1-1.11, which is a multiple-channel bioelectrical signalrecorder.

Section 1.14. The bioelectrical signal acquisition device of any ofSections 1.1-1.13, comprising two reference electrodes attached to theheadband, wherein each of the reference electrodes is positioned on theheadband to contact the skin above an ear of the user, when the userwears the bioelectrical signal acquisition device on the user's head.

Section 1.15. The bioelectrical signal acquisition device of any ofSections 1.2-1.14, wherein the sensing electrode and the groundingelectrode are positioned on the headband to contact the skin on theforehead or around the eyes, symmetrical of a sagittal plane of theuser's body, when the user wears the bioelectrical signal acquisitiondevice on the user's head.

Section 1.16. The bioelectrical signal acquisition device of any ofSections 1.2-1.15, wherein the sensing electrode, the referenceelectrode, and the grounding electrode are integrated in the headband.

Section 1.17. The bioelectrical signal acquisition device of Section1.16, wherein the sensing electrode, the reference electrode, and thegrounding electrode are integrated in the headband to not disturb theuser when the user sleeps or prepares to fall asleep.

Section 1.18. The bioelectrical signal acquisition device of any ofSections 1.1-1.17, wherein the headband is made from soft and elasticmaterial and configured to not disturb the user when the user sleeps orprepares to fall asleep.

Section 1.19. The bioelectrical signal acquisition device of any ofSections 1.8-1.18, wherein the signal wires are integrated in theheadband and configured to not disturb the user when the user sleeps orprepares to fall asleep.

Section 1.20. The bioelectrical signal acquisition device of any ofSections 1.1-1.18, wherein the reference electrode comprises conductivefibric.

Section 1.21. The bioelectrical signal acquisition device of any ofSections 1.1-1.18, wherein the reference electrode is configured toencircle the segment of the headband.

Section 1.22. The bioelectrical signal acquisition device of any ofSections 1.1-1.21, wherein the digital bioelectrical signals compriseelectroencephalogram (EEG), electromyogram (EMG), and/orElectrooculography (EOG) signals of the user when the user sleeps orprepares to fall asleep.

Section 1.23. The bioelectrical signal acquisition device of any ofSections 1.1-1.21, wherein the digital bioelectrical signals compriseEEG signals of the user when the user sleeps or prepares to fall asleep.

Section 1.24. The bioelectrical signal acquisition device of any ofSections 1.1-1.21, wherein the digital bioelectrical signals compriseEEG and EOG signals of the user when the user sleeps or prepares to fallasleep.

System

Section 2.1. An interactive system, comprising:

the bioelectrical signal acquisition device of any of Sections 1.1-1.24,and

a computational unit configured to receive the digital bioelectricalsignals from the bioelectrical signal acquisition device, process thedigital bioelectrical signals and execute one or more logic sets basedon the digital bioelectrical signals.

Section 2.2. The interactive system of Section 2.1, which is configuredto monitor sleep patterns of the user when the user sleeps or preparesto fall asleep.

Section 2.3. The interactive system of Section 2.1, which is configuredto monitor existence and pattern of ocular event-related potentials(o-ERPs).

Section 2.4. The interactive system of Section 2.3, which is configuredto monitor eye blink, eye movement, or eyelid squeezing by processingthe digital bioelectrical signals.

Section 2.5. The interactive system of any of Sections 2.1-2.2, whereinthe computational unit is a personal computer, a tablet computer, asmart phone, a generic microprocessor, or a specialized microprocessor.

Section 2.6. The interactive system of Section 2.5, wherein thecomputational unit is structurally independent from, an integratedcomponent of, an accessory of, or an extension of the bioelectricalsignal acquisition device.

Section 2.7. The interactive system of any of Sections 2.1-2.6, whereinthe computational unit further comprises a low-pass filter, a high-passfilter, or a band-pass filter, or a combination thereof, configured toconduct a digital filtering process on the digital bioelectricalsignals.

Section 2.8. The interactive system of any of Sections 2.1-2.7, furthercomprising an audio unit, which is configured to provide audio signalsto the user.

Section 2.9. The interactive system of Section 2.8, wherein the audiounit includes an audio earplug, a pair of audio-earplugs, a headset, ora speaker.

Section 2.10. The interactive system of any of Sections 2.7-2.8, whereinthe audio unit is operationally connected to the computational unit andprovides audio signals under control of the computational unit.

Section 2.11. The interactive system of any of Sections 2.7-2.10,wherein the audio unit is structurally independent from, an integratedcomponent of, an accessory of, or an extension of the computationalunit.

Section 2.12. The interactive system of any of Sections 2.4-2.7, whereinthe audio unit connects to the computational unit via wire or wirelessconnection.

Method 1

Section 3.1. A method of monitoring sleep patterns of a user,comprising:

providing an interactive system of any of Sections 2.1-2.12;

collecting the digital bioelectrical signals of the user with thebioelectrical signal acquisition device when the user sleeps or preparesto fall asleep; and

processing the digital bioelectrical signals with the computational unitto monitor the sleep patterns of the user.

Section 3.2. The method of Section 3.1, wherein the digitalbioelectrical signals include EEG, EOG, or EMG signals, or anycombination thereof.

Section 3.3. The method of Section 3.1, wherein the processing thedigital bioelectrical signals includes wave analysis of time-domainsignals and spectrum analysis of frequency-domain signals.

Section 3.4. The method of Section 3.1, wherein the sleep patternsinclude sleep stage, sleep depth and derived results, including totalsleep time, onset latency, wake after sleep onset, and sleep efficiency.

Method 2

Section 4.1. A method of human-computer interaction using an interactivesystem, comprising:

providing a signal sequence to the user;

recording digital bioelectrical signals from the user's head using abioelectrical signal acquisition device;

processing the digital bioelectrical signals and identifying theexistence and the pattern of ocular event-related potentials (o-ERPs);and

taking one or more actions based on the existence and the patterns ofthe o-ERPs.

Section 4.2. The method of Section 4.1, wherein the interactive systemis the interactive system of Sections 2.1-2.12.

Section 4.3. The method of Section 4.2, wherein the digitalbioelectrical signals from the user's head are collected by thebioelectrical signal acquisition device of Sections 1.1-1.24.

Section 4.4. The method of Section 4.2, wherein the digitalbioelectrical signals are processed by the computational unit.

Section 4.5. The method of any of Sections 4.1-4.4, wherein providingthe signal sequence to the user comprises touching the user, sendingvibration to the user, playing sound to the user, or applying light tothe user, or any combinations thereof.

Section 4.6. The method of any of Sections 4.5, wherein signal sequenceincludes: a description, a question, or an instruction, or anycombination thereof, all relating to upcoming interactions between theuser and the interactive system.

Section 4.7. The method of Section 4.6, wherein providing the signalsequence to the user comprises playing a plurality of sounds to the userwith the audio unit in any of Sections 2.4-2.9.

Section 4.8. The method of any of Sections 4.6-4.7, wherein thedescription includes an explanation of the upcoming interactions, andthe explanation is about context, or past, current and expected logicstates of the upcoming interactions.

Section 4.9. The method of any of Sections 4.6-4.8, wherein the questionincludes a presentation of one or more questions and list of choices forthe upcoming interactions.

Section 4.10. The method of any of Sections 4.6-4.9, wherein theinstruction includes information on how to provide a response,preferably making a selection among the choices presented in Section4.6.

Section 4.11. The method of Section 4.10, wherein providing a responseincludes eye blink, eye movement, or eyelid squeezing, or anycombination thereof, by the user.

Section 4.12. The method of any of Sections 4.7-4.11, wherein theplurality of sounds include one or more rhythmic audio templates.

Section 4.13. The method of Section 4.12, wherein the rhythmic audiotemplates include sounds of beats, metronome, ding, chirp, ticking,amplitude-modulated tones or noises, frequency-modulated tones ornoises, binaural beats, music pattern, or any form of rhythmic sound.

Section 4.14. The method of Section 4.13, wherein the rhythmic audiotemplates have a rhythmic frequency between 0.5 Hz and 4 Hz, preferablybetween 1 Hz and 2 Hz.

Section 4.15. The method of any of Sections 4.1-4.14, wherein the o-ERPsresult from eye blinking, eye movement, or eyelid squeezing, or anycombination thereof, by the user.

Section 4.16. The method of any of Sections 4.1-4.15, wherein thedigital bioelectrical signals have a sample rate ranging from 100samples per second to 10000 samples per second, preferably from 250 to1000 samples per second.

Section 4.17. The method of any of Sections 4.1-4.16, wherein processingthe digital bioelectrical signals includes a digital filtering process,using a low-pass filter, a high-pass filter, or a band-pass filter, or acombination thereof.

Section 4.18. The method of Section 4.17, wherein processing the digitalbioelectrical signal includes applying a fast Fourier transform (FFT) todata derived from the digital bioelectrical signals to generate afrequency-domain presentation.

Section 4.19. The method of Section 4.18, wherein processing the digitalbioelectrical signal further includes applying a window function to thedata derived from the digital bioelectrical signals before the FFT.

Section 4.20. The method of Section 4.18, wherein processing the digitalbioelectrical signal further includes applying a zero-padding stepbefore applying the FFT transformation to raise a number of samples byan N^(th) order of 2, where N is a positive integer.

Section 4.21. The method of Section 4.18, wherein processing the digitalbioelectrical signal further includes applying a step of down samplingbefore the FFT, reducing the sample rate between 100 and 1000,preferably between 120 and 300.

Section 4.22. The method of any of Sections 4.1-4.21, whereinidentifying the o-ERPs is based on a time-domain presentation, alsoknown as a wave chart, wherein an x-axis represents time, and a y-axisrepresents the amplitude of an electrical voltage.

Section 4.23. The method of any of Sections 4.1-4.21, whereinidentifying the o-ERPs is based on a frequency-domain presentation, alsoknown as a spectrogram, wherein an x-axis represents time, and a y-axisrepresents frequencies.

Section 4.24. The method of any of Sections 4.1-4.21, whereinidentifying the o-ERPs is based on a pattern recognition of the o-ERPsbased on one or more thresholds in the time-domain presentation, or oneor more thresholds in frequency-domain presentation.

Section 4.25. The method of Section 4.24, wherein the patternrecognition of the o-ERPs includes a template matching algorithm,utilizing a template selected from sine waves, triangle wave, rectanglewaves, and other periodic waves with the same frequency as the audio'srhythm, enveloped by the binary sequence from the pattern.

Section 4.26. The method of any of Sections 4.1-4.25, wherein the one ormore actions include triggering one or more steps of conditionalchoices.

Section 4.27. The method of any of Sections 4.1-4.26, wherein one stepof the conditional choices includes a binary-choice conditional branch,which is triggered by a presence of a detected o-ERP during apre-determined time period.

Section 4.28. The method of any of Sections 4.1-4.26, wherein one stepof the conditional choices includes a multiple-choice conditionalbranch, which is triggered by two or more detected o-ERPs during apre-determined time period.

Section 4.29. The method of any of Sections 4.1-4.28, wherein the one ormore actions are taken by the computational unit, the audio unit, or thebioelectrical signal acquisition device.

Section 4.30. The method of Section 4.29, wherein the action includes:playing additional sounds with increased or decreased volume, playing apre-recorded audio file, repeating a previous question, triggering afunction menu, starting an insomnia treatment session, startingrecording sound, sending a message, or sharing current sleep status insocial media, or any combination thereof.

Method 5

Section 5.1. A method of detecting ocular event-related potentials(o-ERPs), comprising:

recording digital bioelectrical signals from the user's head using abioelectrical signal acquisition device; and

processing the digital bioelectrical signals with a computational unitand identifying the existence and the pattern of ocular event-relatedpotentials (o-ERPs).

Section 5.2. The method of Section 5.1, wherein the bioelectrical signalacquisition device and the computational unit are from the interactivesystem of any of Sections 2.1-2.12.

Section 5.3. The method of any of Sections 5.1-5.2, wherein the o-ERPsresult from eye blink, eye movement, or eyelid squeezing, or anycombination thereof, by the user.

Section 5.4. The method of any of Sections 5.1-5.3, wherein the digitalbioelectrical signals have a sample rate ranging from 100 samples persecond to 10000 samples per second, preferably from 250 to 1000 samplesper second.

Section 5.5. The method of any of Sections 5.1-5.4, wherein processingthe digital bioelectrical signals includes a digital filtering processusing a low-pass filter, a high-pass filter, or a band-pass filter, or acombination thereof.

Section 5.6. The method of Section 5.5, wherein a filter type is used inthe digital filtering process, and the filter type is Butterworth,Chebyshev 1, Chebyshev 2, or Elliptic.

Section 5.7. The method of any of Sections 5.5-5.6, wherein: thelow-pass filter has a cut-off frequency that is between 4 Hz and 48 Hz,preferable between 35 and 45 Hz; and the low-pass filter has a number oforder that is between 1 and 14, preferable between 8 and 12.

Section 5.8. The method of any of Sections 5.5-5.7, wherein the low-passfilter is 10th order Butterworth with a cut-off at 40 Hz.

Section 5.9. The method of any of Sections 5.5-5.7, wherein the low-passfilter has a lower cut-off frequency between 0.25 Hz and 2 Hz,preferable between 0.5 Hz and 1 Hz.

Section 5.10. The method of any of Sections 5.5-5.6, wherein: theband-pass filter has an upper frequency limit between 4 Hz and 48 Hz,preferable between 35 Hz and 45 Hz; and the band-pass filter has a lowerfrequency limit between 0.25 Hz and 2 Hz, preferable between 0.5 Hz and1 Hz.

Section 5.11. The method of any of Sections 5.1-5.10, wherein processingthe digital bioelectrical signal includes applying a fast Fouriertransform (FFT) to data derived from the digital bioelectrical signalsto generate a frequency-domain presentation.

Section 5.12. The method of Section 5.11, wherein processing the digitalbioelectrical signal further includes applying a window function to thedata derived from the digital bioelectrical signals before the FFT.

Section 5.13. The method of Section 5.12, wherein the window functionincludes rectangular window, triangular window, Parzen window, Welchwindow, sine window, cosine-sum window, Hann window, Hamming window,Blackman window, or Nattall window, or other common window functions inthe field of digital signal processing; preferably a Hann window.

Section 5.15. The method of any of Sections 5.12-5.13, wherein thewindow function has a window size ranging between 100 to 100000 samples,preferably collected in N seconds, where N is a positive integer.

Section 5.15. The method of any of Sections 5.11-5.14, whereinprocessing the digital bioelectrical signal further includes applying azero-padding step before applying the FFT transformation to raise anumber of samples by an N^(th) order of 2, where N is a positiveinteger.

Section 5.16. The method of any of Sections 5.11-5.15, whereinprocessing the digital bioelectrical signal further includes applying astep of down sampling before the FFT, reducing the sample rate between100 and 1000, preferably between 120 and 300.

Section 5.17. The method of any of Sections 5.1-5.16, whereinidentifying the o-ERPs is based on a time-domain presentation, alsoknown as a wave chart, wherein an x-axis represents time, and a y-axisrepresents the amplitude of an electrical voltage on.

Section 5.18. The method of any of Sections 5.1-5.16, whereinidentifying the o-ERPs comprises identifying patterns in a time-domainpresentation, with a threshold range from 5 to 300 uV, preferablybetween 20 to 100 uV.

Section 5.19. The method of any of Sections 5.1-5.16, whereinidentifying the o-ERPs comprises detecting long gaps betweenzero-crosses in the time-domain presentation, with a threshold rangefrom 0.01 second to 0.2 second, preferably between 0.05 second to 0.15second.

Section 5.20. The method of any of Sections 5.1-5.16, whereinidentifying the o-ERPs comprises template matching with a predefinedo-EPR template in the time-domain presentation, with a matching scorethreshold range from 20 to 90, preferably between 60 to 80.

Section 5.21. The method of any of Sections 5.1-5.16, whereinidentifying the o-ERPs is based on a frequency-domain presentation, alsoknown as a spectrogram, wherein an x-axis represents time, and a y-axisrepresents frequencies.

Section 5.22. The method of any of Sections 5.1-5.16, whereinidentifying the o-ERPs is based on a pattern recognition of the o-ERPsbased on identifying patterns outside a first threshold range in thetime-domain presentation, or identifying patterns outside a secondthreshold range in the frequency-domain presentation.

Section 5.23. The method of Section 5.22, wherein the patternrecognition of the o-ERPs includes a template matching algorithm,utilizing a template selected from sine waves, triangle wave, rectanglewaves, and other periodic waves with the same frequency as the audio'srhythm, enveloped by the binary sequence from the pattern.

What is claimed is:
 1. A method of human-computer interaction using aninteractive system that includes a computational unit and abioelectrical signal acquisition device, comprising: providing a signalsequence to the user with the computational unit; recording digitalbioelectrical signals from the user's head using the bioelectricalsignal acquisition device; processing the digital bioelectrical signalswith the computational unit to identify the existence and the pattern ofocular event-related potentials (o-ERPs) by setting a threshold rangeand analyzing the digital bioelectrical signals in a spectrogram basedon the threshold range, wherein the o-ERPs are produced by voluntary eyemovement when the user's eyes are closed but not when the user's eyesare open or voluntary eyelid squeezing when the user's eyes are closedbut not when the user's eyes are open, as a response to the signalsequence; and initiate a sleep diary, execute sound control, or startsleep induction with the computational unit based on the existence andthe patterns of the o-ERPs.
 2. The method of claim 1, wherein the signalsequence comprises sending vibration to the user or playing sound to theuser.
 3. A method of monitoring ocular event-related potentials (o-ERPs)using an interactive system that includes a computational unit and abioelectrical signal acquisition device, comprising: recording digitalbioelectrical signals from a user's head using the bioelectrical signalacquisition device; and processing the digital bioelectrical signalswith the computational unit to identify the existence and the pattern ofocular event-related potentials (o-ERPs) by: applying a Fouriertransform to data derived from the digital bioelectrical signals togenerate a frequency-domain presentation, and identifying the existenceand the pattern of the o-ERPs by setting a threshold range and analyzingthe digital bioelectrical signals based on the threshold range in thefrequency-domain presentation, wherein the o-ERPs are produced byvoluntary eye movement when the user's eyes are closed but not when theuser's eyes are open or voluntary eyelid squeezing when the user's eyesare closed but not when the user's eyes are open, as a response to asignal sequence provided to the user by the computational unit.
 4. Themethod of claim 3, wherein providing the signal sequence to the usercomprises sending vibration to the user, playing sound to the user, orapplying light to the user.
 5. The method of claim 3, wherein the signalsequence includes: a description, a question, or an instruction, allrelating to upcoming interactions between the user and the interactivesystem.
 6. The method of claim 5, wherein the signal sequence includesan instruction, and the instruction includes information on how toprovide a response by the user.
 7. The method of claim 6, whereinproviding a response includes an eye movement or an eyelid squeezing bythe user.
 8. The method of claim 3, wherein the signal sequencecomprises a plurality of sounds, and the plurality of sounds include oneor more rhythmic audio templates.
 9. The method of claim 8, wherein theone or more rhythmic audio templates have a rhythmic frequency between0.5 Hz and 4 Hz.
 10. The method of claim 3, wherein the digitalbioelectrical signals have a sample rate ranging from 100 samples persecond to 10000 samples per second.
 11. The method of claim 3, whereinprocessing the digital bioelectrical signals further includes afiltering process, which includes using a low-pass filter, a high-passfilter, or a band-pass filter to filter the digital bioelectricalsignals.
 12. A method of human-computer interaction using an interactivesystem that includes a computational unit and a bioelectrical signalacquisition device, comprising: playing series of rhythmic audio signalsto the user with the computational unit; recording digital bioelectricalsignals from the user's head using the bioelectrical signal acquisitiondevice; processing the digital bioelectrical signals with thecomputational unit to identify the existence and the pattern of ocularevent-related potentials (o-ERPs) by: applying a Fourier transform todata derived from the digital bioelectrical signals to generate afrequency-domain presentation, and identifying the existence and thepattern of the o-ERPs by setting a threshold range and analyzing thedigital bioelectrical signals based on the threshold range in thefrequency-domain presentation, wherein the o-ERPs are produced by theuser by voluntary eyelid squeezing when the user's eyes are closed butnot when the user's eyes are open, as a response to the series ofrhythmic audio signals; and inducing the user to fall asleep byproviding audio instructions to the user with the computational unitbased on a selection corresponding to the existence and the patterns ofthe o-ERPs that have a same pace as the series of rhythmic audiosignals.
 13. The method of claim 12, wherein the rhythmic audio signalsinclude sounds of beats, metronome, ding, chirp, ticking, or musicpattern.